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Abstract. We study general (not necessarily Hamiltonian) first-order symmetric sys- 
tems Jy'(t) — B(t)y(t) = A(t)/(t) on an interval [a, b) with the regular endpoint a. The 
deficiency indices n± of the corresponding minimal relation T m i n may be arbitrary (pos- 
sibly unequal). Our approach is based on the concept of a decomposing boundary triplet, 
which enables one to parametrize various classes of extensions of T m ; n (self-adjoint, m- 
dissipative, etc.) in terms of boundary conditions imposed on regular and singular values 
of a function y 6 domT max at the endpoints a and b respectively. In particular, we de- 
scribe self-adjoint and A-depending Nevanlinna boundary conditions which are analogs of 
separated ones for Hamiltonian systems. With a boundary value problem involving such 
conditions we associate the m-function m(-), which is an analog of the Titchmarsh-Weyl 
coefficient for the Hamiltonian system. In the simplest case of minimal (unequal) defi- 
ciency indices n± the m-function m(-) coincides with the rectangular Titchmarsh-Weyl 
coefficient introduced by Hinton and Schneider. We parametrize all m-functions in terms 
of the Nevanlinna boundary parameter at the endpoint b by means of the formula similar 
to the known Krein formula for resolvents. Application of these results to differential 
operators of an odd order enables us to complete the results by Everitt and Krishna 
Kumar on the Titchmarsh-Weyl theory of such operators. 



1. Introduction 

Assume that H and H are finite dimensional Hilbert spaces with dimi? = v+ and 
dim H — v and let 

(1.1) H = H®H, U = H ®H = H®H®H. 

The main object of the paper is a first-order symmetric system of differential equations 
defined on an interval X = [a, b),— oo < a < 6 < oo, with the regular endpoint a and singular, 
generally speaking, endpoint b. Such a system is of the form [1, 14] 

(1.2) Jy'(t)-B(t)y(t) = A(t)f(t), teX, 
where B(t) — B*{t) and A(t) > are the [H]-valued functions on I and 

H ®H ®H H ®H ®H. 

We suppose that the system (1.2) is definite, that is for each A 6 C the equalities 
(1.4) Jy'(t) - B(t)y(t) = XA(t)y(t) 

and A(t)y(t) = a.e. on 1 yield y(t) = 0, tel. 
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The system (1.2) is called Hamiltonian if H — {0}, in which case 

(1.5) J= {jH 1 H ® H ~* H (BH ' 

Assume that C 2 A iX) is the semi-Hilbert space of H- valued functions f(t) on 1 with 

\\.f\\ A ■= f(A(t)f(t),f(i))fcdt < oo, L\(I) is the corresponding Hilbcrt space of equiv- 
i 

alence classes, tt is a quotient map from C 2 A (X) onto L A (T) and tt = tt © tt. Denote also by 
£ 2 A [1C,M] the set of all operator functions Y(t)(e [/C,H]) on 1 such that Y(t)h £ C 2 A (X) for 
each h £ K, (here K, is a finite dimensional Hilbert space). 

As is known the extension theory of symmetric linear relations is the natural approach 
to boundary value problems involving symmetric systems (see [39, 28, 7, 8, 17, 23, 2, 29] 
and references therein). According to [39] the system (1.2) generates linear relations T m in 
and T m ax in C 2 A {I) and minimal and maximal relations T min = nTmin and T max = TrTmax 
in L A (T). It turns out that T mm is a closed symmetric relation with not necessarily equal 
deficiency indices n± and T max — T* min . Moreover, the equality 

(1.6) [y, z] b = lim( J y(t),z(t)), y, z £ domTmax, 

tfb 

defines a skew-Hermitian bilinear form on the domain of Tmax with finite indices of inertia 
i>b+ and Vb-. 

A description of various classes of extensions of T mm (self-adjoint, m-dissipative, etc.) in 
terms of boundary conditions is an important problem in the spectral theory of symmetric 
systems. In particular, a boundary value problem for the system (1.2) with self-adjoint 
separated boundary conditions generates the Fourier transform with the spectral function 
of the minimal dimension. Assume that the system (1.2) is Hamiltonian, n + = ri- =: n and 
let y(t) = {yo(t),yi{t)}(£ H © H) be the representation of a function y £ AouvTmax- Then 
according to [19] the general form of self-adjoint separated boundary conditions is 

(1.7) cosBiyo(a) +sinBiyi(a) = 0, [y,Xj]b = 0, j = 1 -v- Vb, V G dom7^ aa; , 

where B\ = Bl £ [H], Vb = n — dimH and xi, %2; • • • , Xv h are linearly independent modulo 
dom 7mm functions from douiTmax such that Xj(0) = an d [Xji Xk]b = 0, j ^ k. An element 
yb := {[y,Xj}b}i b £ C" b is called a singular boundary value of a function y £ domTmax- 
Observe that for differential operators the notion of a singular boundary value as well as 
formula (1.7) go back to the paper by Calkin [3] (see also [9, Ch.13.2]). 

Boundary conditions (1.7) generate a self- adjoint extension A of T min given by A = 
^{{"Uif} £ %nax ■ y satisfies (1.7)}. The resolvent of A is defined by (^4 — A) -1 / = nyf, 
where yf is the /^-solution of the boundary problem involving the system 

(1.8) Jy'(t)-B(t)y(t)=XA(t)y + A(t)f(t), f £ f, AgC\1, 

and the boundary conditions (1.7). Moreover, according to [19] the Titchmarsh - Weyl 
coefficient Mrw(A)(e [H]) of the boundary problem (1.8), (1.7) is defined by the relations 

(1.9) v(t, A) := ip(t, \)M T w (A) + i/)(t, A) £ C 2 A [H, H] and [v(; X)h, Xjjb = 0, h £ H. 

for all j = 1 -7- Vb- Here <p(-, A) and ip(-, A) are the [H, H]- valued operator solutions of Eq. 
(1.4) with the initial data <p(a, A) = (sin B\ : — cosi?i) T and ip(a, A) = (— cosi?i : sini3i) T . 
Note also the paper [26], in which the Titchmarsh - Weyl coefficient is defined by means 
of a limiting process from a compact interval [a,/3] C 1. It turns out that Mtw{-) is a 
Nevanlinna operator function, i.e., Mtw(-) is holomorphic on C\R and ImA-ImMxw(A) > 
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0, M^. W {X) = MtwW, A 6 C\R. Moreover, the spectral function of Mtw(') is a spectral 
function of the corresponding Fourier transform with the minimal dimension. 

Another approach to description of boundary conditions is based on the concept of a 
decomposing boundary triplet for T max (see [38] for symmetric systems and [35, 36, 37] 
for differential operators). To explain this concept note that there exist finite-dimensional 
Hilbert spaces Hb and Hb and a surjective linear map 

(1.10) T b = (r 06 : f 6 : T lb ) T : domT ma * -^Hb®Hb®H b 
such that the bilinear form (1.6) admits the representation 

(1.11) [y, z] b = i- sign (v b+ - v b -)(T b y, T b z) - {T lb y, V bz) + {T ob y, T lb z). 
Moreover, let X a £ [H] be the operator such that X* JX a — J, and let 

r„= (r 0a : f„ : T la y : AC(2;M) ^ H ® H ® H. 

be the block representation of the linear map T a y = X a y(a), y £ AC(X;M) (here AC(X;M) 
is the set of all absolutely continuous H- valued functions on I). By using Hb, Hb and 
T a , Tb one constructs the Hilbert space Ho, the subspace Hi in Ho and the linear maps 
T'j : domTmair — > Hj, j £ {0, 1}, such that the classical Lagrange's identity takes the form 

(1.12) (f,z) A - (y,g) A = (T' iy ,T' z) - (T' y, T' lZ ) + i sign (n+ - n.)(P 2 T' y, P 2 T' z) 

(in (1.12) {y, /}, {z,g} £ T ma x and P 2 is the orthoprojector in Ho onto H 2 := Ho © Hi). 
Finally, a decomposing boundary triplet for T max is defined as a collection II = {Ho © 
Hi, T , Til, in which Tj : T max — > Hj, j £ {0, 1}, arc the linear maps given by 

(1.13) T {yJ} = T' y, T^y, /} = T[y, {y,f}£T max . 
In the case of equal deficiency indices n + = ra_ one has 

H = H (SH b (:=Ho = Hi) 
and the decomposing boundary triplet takes the form II = {"H,r ,ri}, where 

(1.14) T {y, /} = {-r la y + i(f a - f b )y, T ob y}(£ H © H b ), 

(1.15) Ti{yJ} = {T 0a y+^(T a + f b )y,-Ti b y}(£H ®Hb), {y,f} £T max . 
Moreover, for the Hamiltonian system with n + = n_ one has H = H ®Hb and 

(1.16) T {y, /} = {-r la y, T ob y}(£ H © Hb), T x {y, /} = {r 0a y, -T u y}(£ H © Hb)- 

It turns out that Tby can be represented as a singular boundary value yb of a function 
y £ domTmaa; (for more details see Remark 3.3). Therefore the operators (1.14) and (1.15) 
are defined , in fact, by means of boundary values of a function y at the endpoints a (regular 
value) and b (singular value). At the same time emphasize that a concrete form of the 
map Tb satisfying (1.11) does not matter, which is suitable for a compact representation 
of boundary conditions. To illustrate this assertion note that according to [38] self-adjoint 
separated boundary conditions exists only for a Hamiltonian system (1.2) with n + = n_, in 
which case the general form of such conditions is 

(1-17) cos£?i yo(a) + sini?i yi{a) = 0, 

(1.18) cos B 2 T by + sin B 2 T u y = 0, y £ AomTmax, 
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with self-adjoint operators B\ G [H] and B^ G [H b ]. Formulas (1.17) and (1.18) seem to 
be more convenient than (1.7), because they enable one to parametrize regular self-adjoint 
boundary conditions (1.17) (at the point a) and singular ones (1.18) (at the point b) by 
means of self-adjoint boundary parameters B\ and B2 respectively. 

In the present paper we investigate boundary value problems for general (not necessarily 
Hamiltonian) symmetric systems (1.2) with the aid of decomposing boundary triplets. We 
do not impose any restrictions on the deficiency indices n± of T min . To cover the case 
n+ 7^ n_ we consider the following problems: 

- to find and describe A-depending Nevanlinna (in particular, self-adjoint) boundary 
conditions which are analogs of self-adjoint separated boundary conditions for Hamiltonian 
systems; 

- to find the operator functions which are analogs of the Titchmarsh-Weyl coefficient for 
Hamiltonian systems and describe these functions in terms of boundary conditions. 

We suppose that solution of these problems will give rise to generalized Fourier transforms 
for the system (1.2) with the spectral functions of the minimally possible dimension. Our 
investigations are based on a fact that a decomposing boundary triplet n = {Hq®'Hi, Tq, Ti} 
is a boundary triplet for T max in the sense of [33]; moreover, in the case n + = n_ a 
decomposing triplet II = {H, r , T\} is a boundary triplet (boundary value space) for T max 
in the sense of [16, 30]. This makes it possible to apply to the systems (1.2) the general theory 
of boundary triplets for abstract symmetric relations in Hilbert spaces (see [16, 5, 4, 30, 33] 
and references therein). 

Assume for simplicity that n + = n_ and let II = {H, Tq, T{) be a decomposing boundary 
triplet (1.14), (1.15) for T max . By using the results in [4, 30] we show that 

(1-19) T := {{y, /} G T max : T la y = 0, T a y = T b y, T ab y = T lb y = 0} 

is a symmetric extension of T min and each generalized resolvent R(\) of T is defined by 
R{X)j= n(y f (;X)), X G C \ M, where / G C 2 A (1), irf = / and y f (-, A) is the ^-solution 
of the following boundary value problem: 

(1.20) Jy'-B(t)y = XA(t)y + A(t)f(t), iel, 

(1-21) r la y = 0, T a y = T b y, 

(1.22) Co(A)r ob y + C 1 (A)r lb y-0, A G C \ R. 

Here Co(A)(e [H b ]) and Ci(A)(G \H b ]) are components of a Nevanlinna operator pair t(A) = 
{(Co (A), Ci(A))}, so that (1.22) defines a Nevanlinna boundary condition at the singular 
endpoint b. A pair r = r(A) plays a role of a boundary parameter, since R(X) runs over 
the set of generalized resolvents of T when r(A) runs over the set R(H b ) of all Nevanlinna 
operator pairs. To emphasize this fact we write R(X) = R T (X). Observe also that a particular 
case of a boundary parameter r G R{T-L b ) is r(A) = {(7, K(X))}, where K(X) is a Nevanlinna 
operator function. 

The boundary problem (1.20)-(1.22) defines a canonical resolvent R T (X) if and only if r 
is a self-adjoint operator pair r = {(cos.B,smi?)} with some B = B* 6 [H b ]. In this case 

(1.23) R T (X) = (A T - X)- 1 , AeC\R, 

where A T is a self-adjoint extension of T min defined by the following mixed boundary con- 
ditions (c.f. (1.17) and (1.18)): 

Ti a y = 0, f a y = T b y, cos B ■ T ob y + sin B ■ T lb y = 0. 
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For each A G C \ R denote by 91a(C T max ) the subspace of all {y, /} G T max such 
that / = Ay. According to [5, 30] one associates with the decomposing boundary triplet 
II = {"H,r ,ri} for T max the 7-field 7(A)(G [U,L\(1)]) and the abstract Weyl function 
M(A)(G [H]) defined by 

(1.24) 7 (A) =7n(r p ^Ia) _1 , M(X)h = T 1 {-y(X)h,Xj(X)h}, h&H, AeC\t. 
It turns out that the 7-field satisfies the equality 

{t(\)h)(t)=ir(Z(t,\)h), heH, A e C \ K. 

with some operator /^-solution Z(-, A) G £ A [H,M] of Eq. (1.4). This fact enables us to 
show, that for each Nevanlinna boundary parameter r(A) = {(Co(A), Ci(A))} there exists 
a unique operator /^-solution v T (-, A) G /3^[i?o,HI] (A G C \ M) of Eq. (1.4) satisfying the 
boundary conditions 

T la (v T (t,X)h ) = -P H h , 

(1.25) i(T a -f b )(v T (t,X)h ) = P s h , 

(1.26) C (X)r ob (v T (t,X)ho) + C 1 (X)T lb (v T (t,X)ho)=0, h £ H , AgC\K 

(here Pr and P H are the orthoprojectors in H onto H and H respectively). By using 
the solution v T (-,X) we introduce the concept of the to- function m T (-) : C \ R — > [Ho] 
corresponding to the boundary parameter r or, equivalently, to the boundary value problem 
(1.20)-(1.22). This function is defined by the following statement: 

for each r(A) = {(Co (A), C\ (A))} G R(Hb) there exists a unique operator function 
to t (A)(g [Hq]) such that the operator solution 

(1.27) v T (t, A) := <p(t, A)m r (A) + 4>(t, A), A G C \ E, 

of Eq. (1.4) belongs to £^[i/ ,lHI] and satisfies the boundary conditions (1.25) and (1.26). 
Here ip(-, A) and ip(-, A) are the [Ho, H]- valued solutions of Eq. (1.4) with the initial data 

(1.28) X alf (a, A) = (G [Ho, H ffi H]), X a ^(a, A) = (^jpfj (e [^0,^0 © H]). 

The m-function m T (-) is called canonical if t = {(cos i?, sin i?)} is a selfa-adjoint operator 
pair or, equivalently, if m T (-) corresponds to the canonical resolvent (1.23). In this case the 
boundary condition (1.26) can be written as 

(1.29) cosB ■Tob(v T (t,X)ho) + sinB ■T lb (v T (t,X)h ) = 0, h G H , A G C \ M. 

It turns out that under the special choice of the maps Fob and Tit the condition (1.29) 
takes the form of the second relation in (1.9). This and (1.27) imply that in the case of the 
Hamiltonian system (1.2) the canonical m-function m r (-) coincides with the Titchmarsh- 
Weyl coefficient Mtw( ) in the sense of [19] (for more details see Remark 6.11). 

We show in the paper that all m-functions can be parametrized immediately in terms of 
the Nevanlinna boundary parameter r by means of the formula similar to the known Krcin 
formula for resolvents. More precisely the following theorem holds 

Theorem 1.1. Let U = {"H,r ,ri} be a decomposing boundary triplet for T max and let 

(1.30) M(A) = O^lfx] m!(A)) ■■ H o®H b ^H (BH b , \eC\R, 
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be the block representation of the Weyl function (1.24). Then for every Nevanlinna boundary 
parameter t(X) = {(Co(A), C\ (A))} the corresponding m-function m T (-) is of the form 

(1.31) m T (A) =m (A)+M 2 (A)(C (A) -Ci(A)M 4 (A))- 1 Ci(A)M 3 (A), AeC\K. 

Note that a description of all canonical m-functions of a differential operator in the case of 
maximal deficiency indices of the minimal operator can be found in [15, 13, 21]; similar result 
for Hamiltonian systems was obtained in [18]. In these papers each canonical m-function 
m T (-) is represented as a certain linear fractional transformation of a self-adjoint boundary 
parameter r. Observe also that for a differential operator of an even order with arbitrary 
(possibly unequal) deficiency indices a description of m-functions in the form (1.31) was 
obtained in [34]. 

It turns out that m r (-) is a Nevanlinna operator function satisfying the inequality 

(1.32) (ImA)- 1 • Imm T (A) > J v*(t, X)A(t)v T {t, X)dt, X G C \ E, 
Moreover, the canonical m-function m r (-) satisfies the identity 

(1.33) ra r (/i) — m* (A) = (/U — A) J v*(t, X)A(t)v T (t, /j.) dt, /i,AgC\R, 

which implies that for the canonical m-function the inequality (1.32) turns into the equality. 
The identity (1.33) follows from the fact that m T (-) is the abstract Weyl function of a 
boundary triplet for some symmetric extension of T m i n . Note that for the Titchmarsh-Weyl 
coefficient Mtw(') of the Hamiltonian system the identity (1.33) was proved in [19]. 

In the case of minimal equal deficiency indices n + = n_(= v_) the extension T in (1.19) 
is self-adjoint and the boundary condition (1.22) vanishes. Therefore in this case there exists 
a unique (canonical) m-function m(-) of the problem (1.20), (1.21), which coincides with the 
abstract Weyl function M(A) (sec (1.24)). 

Actually we consider symmetric systems with arbitrary (possibly unequal) deficiency 
indices n±. To this end we use the decomposing boundary triplet II = {rlo 'Hi,r'o,ri} 
with possibly unequal Hilbert spaces Ho and Hi (see (1.13)), which enables us to obtain the 
results similar to those specified above for the case n + = n_. In particular, we define the 
m-function m T (A)(£ [Ho]) and describe all the m-functions by means of formulas similar to 
(1.31). It turns that m T (-) is a Nevanlinna function, which in the case n + < n_ has the 
triangular form 

(1.34) m T (A) £), XeC + . 

Emphasize that for the system (1.2) with n + ^ ra_ there are no longer canonical m-functions. 

The simplest situation is in the case of minimal deficiency indices n± = v± (for not 
Hamiltonian systems (1.2) this implies that n+ < n_). In this case there exists a unique 
m-function m(-), which has the triangular form 

(1.35) m(A) = (iV+ ( (A) ^j}j- H ® H ^ H ® H i AeC+. 
Here the entries M(A) and ^V + (A) are taken from the block representation 

(1.36) M+(A) = (M(A) : N+{X)) T :H^H®H, X G C+, 

of the abstract Weyl function M + (-) corresponding to the decomposing boundary triplet n 
(see Definition 2.11). Note in this connection that the systems (1.2) with minimal deficiency 
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indices n± were studied in the paper by Hinton and Schneider [20] , where the concept of the 
"rectangular" Titchmarsh-Weyl coefficient Mtw/(A)(g [H, H®H}), A G C+, was introduced. 
This coefficient is defined by the relation 

(1.37) ip(t, \)M TW (A) + x{t, A) G C\ [H, H] , A G C+, 

where tp(t,\)(£ [Ho,H]) and x(i, A)(g [if, H]) are the operator solutions of Eq. (1.4) with 
the initial data 

(1.38) X a <p(a,\) = (G [H ,H ®H]), X aX (a,X) = (jjj (G [H,H ®H]) 

(c.f. (1.28)). It is not difficult to prove that the abstract Weyl function (1.36) coincides with 
MtwW ( see Remark 6.3). 

In the final part of the paper we consider the operators generated by a differential ex- 
pression l[y] of an odd order r = 2n + 1 defined on an interval I = [a,b) (see (7.1)). 
Such differential operators have been investigated in the papers by Everitt and Krishna 
Kumar [10, 11, 12, 27], where the limiting process from the compact intervals [a,0\ C T 
was used for construction of (n+ l)-component operator L 2 -solutions v(t, A) of the equation 
l[y] = Ay, A G C \ R. With each solution v(t, A) the authors associate curtain boundary 
conditions and the Titchmarsh-Weyl matrix MtwW — ( m rs(A))^l 1 . These results are 
not completed; in particular, they do not enable to define self-adjoint boundary conditions 
without some hardly verifiable assumptions even in the case of equal minimally possible 
deficiency indices n+(Lo) = n-(Lo) = n + 1 of the minimal operator Lq. 

Our approach is based on the known fact [24] that the equation l[y] = \y is equivalent 
to some symmetric not Hamiltonian system (1.4). This enables us to extend the results 
obtained for symmetric systems to differential operators of an odd order with arbitrary 
deficiency indices n±(L ). In particular, we define the m-function m T (-) of such an operator 
and describe all m-functions immediately in terms of a Nevanlinna boundary parameter r. 

Note in conclusion that the Green's functions of generalized resolvents i? T (A) and the 
generalized Fourier transform for symmetric systems will be considered in the forthcoming 
paper. 



2. Preliminaries 

2.1. Notations. The following notations will be used throughout the paper: f), H denote 
Hilbert spaces; ["Hi,?^] is the set of all bounded linear operators defined on the Hilbert 
space Hi with values in the Hilbert space H2] [H] := [H,V.]; A \ C is the restriction of an 
operator A onto the linear manifold C; Pc is the orthogonal projector in onto the subspacc 
C C f); C+ (C_) is the upper (lower) half-plane of the complex plane. 

Recall that a closed linear relation from Ho to Hi is a closed linear subspace in Ho® Hi. 
The set of all closed linear relations from Ho to Hi (in H) will be denoted by C(Ho,Hi) 
(C(H)). A closed linear operator T from Ho to Hi is identified with its graph grT G 
C(Ho, Hi). 

For a linear relation T G C(Ho,Hi) we denote by domT, ranT, kerT and mulT the 
domain, range, kernel and the multivalued part of T respectively. Recall also that the inverse 
and adjoint linear relations of T are the relations T^ 1 G C(Hi,Ho) and T* G C(Hi,Ho) 
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defined by 

T- 1 = {{h u h } eHi®n : {h , hi} G T} 

(2.1) T* = {{ki,ko} G Hi (B Ho : (k , ho) - {hi, hi) = 0, {ho, hi} G T}. 

In the case T G C(H ,Hi) we write G p(T) if kcrT = {0} and ranT = Hi, or 
equivalently if T -1 G ["Hi, Ho]; S p(T) if kerT = {0} and ranT is a closed subspace in 
Hi. For a linear relation T G C("H) we denote by p(T) := {A G C : G p(T — A)} and 
fKT) = {A G C : G p(T — A)} the resolvent set and the set of regular type points of T 
respectively. 

Recall also the following definition. 

Definition 2.1. A holomorphic operator function $(•) : C\M — > [H] is called a Nevanlinna 
function if Im A • Im$(A) > and $*(A) = $(A), A G C \ R. 

2.2. Holomorphic operator pairs. Let A be an open set in C, let K,,Ho,l-li be Hilbert 
spaces and let Cj(-) : A — > [Hj,)C], j G {0,1} be a pair of holomorphic operator functions 
(in short a holomorphic pair). Two such pairs Cj(-) : A — > [Hj,JC] and Cj(-) : A — > [Hj,K,'] 
are said to be equivalent if there exists a holomorphic isomorphism <p(-) : A — > [K,,K,'\ such 
that C'j(X) — <fi(X)Cj(X), A G A, j G {0,1}. Clearly, the set of all holomorphic pairs splits 
into disjoint equivalence classes; moreover, the equality 

(2.2) r(A) = {(C (A), Ci(A)); /C} := {{^ , hi} C (A)/i + Ci(A)/ii = 0} 

allows us to identify such a class with the C(Ho, %i)-valued function t(A), A G A. 

In what follows, unless otherwise stated, T~Lo is a Hilbert space, Hi is a subspace in Ho, 
Hi := Ho Q Hi and Pj is the orthoprojector in Ho onto Hj, j G {1, 2}. 

Let a G {— 1,+1}. With each linear relation 9 G C(Ho,Hi) we associate the x-adjoint 
linear relation 8* G C(Ho,Hi) given by 

01 = {{k ,ki} EHo®Hi : (ki,h )-(ko,h 1 )+ia(P 2 ko,P 2 ho) = for all {h ,hi} G 6}. 

It follows from (2.1) that in the case Ho = Hi =: H one has 9* — 9* . 
Next assume that IC + and /C_ are auxiliary Hilbert spaces and 

(2.3) r + (A) = {(Co(A),C 1 (A));/C + }, A G C+; r_(A) = {(D (\),Di(\));tC-}, A G C_ 
are equivalence classes of the holomorphic pairs 

(2.4) (C (A) :Ci(A)) :Ho®Hi ->K+, A G C+ 

(2.5) (D (A):Di(A)):ftoeWi->£_, A G C_. 
Assume also that 

C (A) = (Coi(A) : C 02 (A)) : Hi © H 2 -> /C+; D (A) = (D i(A) : £> 02 (A)) : Hi © H 2 -»• /C_ 
are the block representations of Co (A) and A) (A). 

Definition 2.2. Let as before a G { — 1, +1}- A collection r = {r + , r_} of two holomorphic 
pairs (2.3) (more precisely, of the equivalence classes of the corresponding pairs) belongs to 
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the class R a (Ho,Hi) if it satisfies the following relations: 



(2.6) 2Im(C 1 (A)C * 1 (A)) + aC 02 (A)C£ 2 (A) > 0, A G C+ 

(2.7) 2Im(£>i(A)£>5 1 (A)) + aD 02 {\)D* 02 {\) < 0, A G C_ 

(2.8) d(A)£>Si(A) - C i(A)DI(A) + iaC 02 (A)^ 2 (A) = 0, A g C+ 

(2.9) if a = +1, then £ p(C (A) -iCi(A)Pi) and G p(A)i(A) + iDi(A)) 

(2.10) ifa = -l, then G p(C i(A) - iC\{\)) and G p(D Q (X) + iDi(X)Pi). 



A collection t = {r + , r_} G R a (Ho, Hi) belongs to the class R° a (Ho, Hi) if for some (and 
hence for any) A G C + one has 

2Im(C 1 (A)C * 1 (A)) + aC Q2 {\)C* m {\) = 0, 
G p(C i(A) + iCi(A)) if a = +1 and £ p(C (A) + iCi(A)Pi) if a = -1. 

The following proposition is immediate from Definition 2.2 and the results of [32]. 

Proposition 2.3. 1) If r = {t+,t_} G R a (H ,Hi), then (— r±(A))* = -r T (A), A G C T , 
and i/ie following equality holds 

(2.11) r T (A) = {{-/ij - M f 2 fe , -Pi/io} : {hi, h Q } G (t±(A))*}. 

4Jj Sac/i collection r = {t + ,t_} G R a {Ho,Hi) given by (2.3) satisfies the relations 

(2.12) if a = +1, £/ien dim/C + = dim "Ho arj d dim/C_ = dim "Hi; 

(2.13) i/ a = — 1, then dim/C+ = dim "Hi and dim/C_ = dim 'Ho 

3) The set R^(Ho,Hi) is not empty if and only if dim "Ho = dim "Hi. TTiis implies that 
in the case dim Ho < oo i/ie set R^(Ho,Hi) is not empty if and only if Ho = Hi =: H. 

4) Each collection r = {t + ,t_} G R^(Ho,Hi) can be represented as a constant 

(2.14) r±(A) = {(C ,Ci);IC} = e(€C(Ho,Hi)), A G C±, 
w/iere Cj G [Hj,JC], j G {0, 1} and (-6)% = -6. 

Moreover, one can easily prove the following proposition. 

Proposition 2.4. //dim "Ho < oo, then a collection t = {t + ,t_} of two holomorphic pairs 
(2.3) belongs to the class R a (Ho,Hi) if and only if it satisfies (2.6)-(2.8), (2.12), (2.13) and 
the following relations 

(2.15) ran(C (A) : Ci(A)) =K+, A G C+; ran (D (A) : Di(A)) = A G C_. 

Remark 2.5. 1) It follows from Proposition 2.3, 2) that for each collection r = {t + ,t_} G 
Ra(Ho, Hi) one can put in the representation (2.3) /C+ = Ho, /C_ = Hi in the case a = +1 
and /C+ = Hi, /C_ = Ho in the case a = — 1. 

2) If Hi = Ho =: H, then the class R(H) := R a {H, H) (a G {-1, +1}) coincides with the 
well-known class of Nevanlinna functions r(-) with values in C(H) (see, for instance, [4]). In 
this case the collection (2.3) turns into the Nevanlinna pair 

(2.16) r(A) = {(C (A),C 1 (A));H}, AgC\M, 
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with Co (A), Ci(A) G [H]. In view of (2.6)-(2.10) such a pair is characterized by the relations 
(cf. [4, Definition 2.2]) 

(2.17) ImA-Im(Ci(A)C *(A)) > 0, Ci(A)C *(A) - C (A)C 1 *(A) = 0, A G C \ K, 

(2.18) G p(C (A) -tCi(A)), AeC+; G p(C (A) + iCi(A)), A G C_. 

Moreover, the function r(-) belongs to the class R°(H) := R^(H,H) if and only if it admits 
the representation in the form of the constant (cf. (2.14)) 

(2.19) t(\) = {(C ,Ci);H} = 9(cC(H)), \eC\R 

with the operators Cj G [H] such that Im(CiCg) = and G p(Co ± iC\) (this means 
that 9 = 9*). Observe also that according to [40] each r G R°(H) admits the normalized 
representation (2.19) with 

(2.20) C =cosB, Ci^sinB, B = B* G [H]. 

Assume now that n := dimH < oo, e = {e^}™ is an orthonormal basis in H, t(A) = 
{(Co(A),Ci(A));"H} is a pair of holomorphic operator-functions C(-) : C \ R — > [H] and 
C;(A) = (ckj,i(\))% j =1 is the matrix representations of the operator C(A), I G {0, 1}, in the 

basis e. Then by Proposition 2.4 r belongs to the class R(H) if and only if the matrices 
Co(A) and Ci(A) satisfy (2.17) and the following equality: 

rank(C (A) : Ci(A)) = n, A G C \ R. 

Moreover, the operator pair 9 = {(Co,Ci);"H} belongs to the class R°(H) if and only if 
Im(CiCp) = and rank (Co : Ci) = n (here Cj = (ckj,l)kj=i 1S the matrix representation 
of the operator C;, / G {0, 1}, in the basis e). Note that such a "matrix" definition of the 
classes R(TL) and R (H) in the case dim'H < oo can be found, e.g. in [8, 25] 

2.3. Boundary triplets and Weyl functions. Let A be a closed symmetric linear relation 
in the Hilbert space Sj, let 9Ta(^4) = ker (A* — A) (A G p(Aj) be a defect subspace of A, let 
m x (A) = {{f,Xf} : / G 9T A (A)} and let n±(A) := dim^A) < oo, A G C± be deficiency 
indices of A. Denote by Ext a the set of all proper extensions of A, i.e., the set of all relations 
A G C(fi) such that Ac Ac A*. 

Next assume that Ho is a Hilbert space, Hi is a subspace in Ho and % := 'Ho QHi, so 
that Ho = Hi (B %2- Denote by Pj the orthoprojector in Ho onto Hj 1 j G {1,2}. 

Definition 2.6. Let a G {-1, +1}. A collection U a = {Ho ® Hi, L , Lx}, where L, : A* 
Hj, j G {0,1} are linear mappings, is called a boundary triplet for A*, if the mapping 
L : / — > {L /, Ti/}, / e A*, from A* into Ho ffi Hi is surjective and the following Green's 
identity 

(2.21) (/', g) - (/, cf) = (Til ng)u - (Tof, Tig)u + ia(P 2 T f, P 2 r ?)« 2 

holds for all / = {/,/'}, g = {g,g'} G A*. 

In the sequel we will also use the notation II + (rcsp. II_) instead of II + i (rcsp. II_i). 

Proposition 2.7. Let II Q = {Ho © Hi, To, Y{\ be a boundary triplet for A* . Then 

(2.22) dimHi = n_(A) < n + (A) = dimH , if a = +1; 

(2.23) dim Hi = n+(A) < n_(A) = dimH , if a = -1. 

Conversely for any symmetric relation A with ri-(A) < n + (A) (resp. n + (A) < ri-(A)) there 
exists a boundary triplet LI + (resp. for A* . 



ON TITCHMARSH-WEYL FUNCTIONS 



11 



Proposition 2.8. Let TL a — {Ho © Hi, To, Ti} be a boundary triplet for A* . Then: 

1 ) ker To fl ker T\ ~ A and Tj is a bounded operator from A* into Hj , j G {0, 1}; 

2) The equality 

(2.24) Aq := kcrT = {/ G A* : T f = 0} 

defines the maximal symmetric extension A G Ext a such that C + C p(A ) in the case 
a = +1 and C_ C p(A ) in the case a = — 1. 

In the following two propositions we denote by ni the orthoprojector in Sj®Sj onto i}ffi{0}. 

Proposition 2.9. Letn-(A) < n + (A) and let H+ = {Ho®H\, T , T{\ be a boundary triplet 
for A*. Then: 

1) the operators To \ ' r Tl\{A), A G C+, and Pi To |" Vt z (A), z G C_, isomorphically map 
Vl\(A) onto Ho and s Jl z (A) onto Hi respectively. Therefore the equalities 

(2.25) 7 +(A) = 7ri(T \ 9Ta(A))-\ X G C+; 7 _(*) = ^(P^o \ 9l z (A)) _1 , z G C_, 

(2.26) M+(A)^ =r 1 { 7+ (A)/io,A 7+ (A)/io}, /io£%, A G C+ 

(2.27) M_(z)h 1 = (T 1 +iP 2 T ){ 7 _(z)h 1 ,z^-(z)h 1 }, foe Hi, z G C_ 

correctly define the operator functions 7 +(-) : C+ — > [Ho, -ft], 7-(0 : C- — > [Hi,Sj] and 
M + {-) : C+ — > [Ho, Hi], M-(-) : C_ — > [Hi, "Ho], which are holomorphic on their domains. 
Moreover, the equality M£(A) — M_(A), A G C_, is valid. 

2) assume that 

(2.28) M+(A) = (M(A) : JV+(A)) : Hi © H 2 Hi, A G C+ 

(2.29) M_(z) - (M(z) : iV_(z)) T : Hi Hi (BH 2 , z EC- 
are the block representations of M + {X) and M_(z) respectively and let 

(2.30) M(X) = :Hi®H2^Hi®H 2 , A G C+ 

(2.31) M(X) = (^X l ° T ) ■■ Hi © H 2 -> Hi 8 H 2 , A g C_. 

\ iV -i A ) _ 2 7 «2/ 

TTien A^(-) is a Nevanlinna operator function satisfying the identity 

(2.32) Al( M )-Ar(A) = (M-A) 7 ;(A)7 + (M), ftAeC + . 

Similar statements for the triplet II_ are specified in the following proposition. 

Proposition 2.10. Let n + (A) < n-{A) and let II = {Ho ©Hi,r ,ri} be a boundary 
triplet for A* . Then: 
1) the equalities 

(2.33) 7+ (A) = 7ri(Pir r K x (A))-\ X G C+; 7 _(s) = m(T \ m z (A))-\ z G C_, 

(2.34) M + (A)/ii = (r 1 -iP 2 r ){ 7+ (A)/i 1 ,A 7+ (A)/i 1 }, hi G Hi, A G C+ 

(2.35) M-(z)h = T 1 {'y-(z)h ,z'y-(z)ho}, h Q eH , z G C_ 

correctly define the holomorphic operator functions 7 +(-) : C + — > [Hi,Sj], 7 -(-) : C_ — > 
[H ,i}] 'andM+(-) : C+ ->■ [Hi,H ], M_(-) : C_ -> [H ,Hi]. 
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2) assume that 

(2.36) M+(A) = (M (A) : iV+(A)) T : Hi -> Hi © H 2 , A e C+ 

(2.37) Af_(«) = (M(«):JV_(«)):WieH 2 -)-Wi, 2 G C_ 
are i/ie Wocfc representations of M+(A) and M_(z) respectively and let 

(2.38) M(A) = ^ ^ : Hi © H 2 -> Hi © H 2 , A G C+ 

(2.39) M(A)=f M <; A) ^Vr^l : Hi © H 2 — )■ Hi ffi H 2 , A 6 C_. 

Then M(-) is a Nevanlinna operator function satisfying the identity 

(2.40) M(jt) - M*{\) = (ji- A)7*(A)7_(/i), /i,AeC-. 

Definition 2.11. The operator functions 7±(-) and M±(-) defined in Propositions 2.9 and 
2.10 are called the 7- fields and the Weyl functions, respectively, corresponding to the bound- 
ary triplet lT a . 

Proposition 2.12. Let Ii a = {Ho © Hi,ro,ri} be a boundary triplet for A* and let 7±(-) 
and M±{-) be the corresponding ^-fields and Weyl functions respectively. Moreover, let the 
spaces Ho and Hi be decomposed as 

Hi = H©Hi, H = HffiH 

(so that Ho = Hi © H 2y ) and let 

T = (f : r ) T : A* -)• H © H , r x = (f j : f i) T : A* -> H © Hi 

&e the block representations of the operators T and r x . Then: 

1) The equality 

A={f€A*:T f = t f = tJ=0} 
defines a closed symmetric extension A G Ext a and the adjoint relation A* of A is 

A* = {feA* :f / = 0}. 

If in addition n±(A) < 00, then the deficiency indices of A are n±(A) — n±(A) — dimH. 

2) The collection Yi a = {Ho © Hi, To f A* , Pi \ A*} is a boundary triplet for A* . 

3) The 7 -fields 7±( - ) and the Weyl functions M±(-) corresponding to Tl a are given by 

7+ (A) = 7+ (A) r Ho, M+(A) = P^M+(A) \ H , A G C+ 

7_(A) = 7- (A) t Hi, M-(A) = ^ M_(A) f Hi, A G C_ 

m t/ie case a = +1 and 6?/ i/ie same formulas with Hi (Ho) in place of Ho (Vesp. HiJ m 
i/ie case a = — 1. 

We omit the proof of Proposition 2.12, since it is similar to that of Proposition 4.1 in [4] 
(see also remark 2.16 below). 

Recall further the following definition. 

Definition 2.13. An operator function R(-) : C\R — > [Sj] is called a generalized resolvent of 
a symmetric linear relation A G C(Sj) if there exist a Hilbert space $) Z) $) and a self-adjoint 
linear relation A G C{f)) such that A C A and R(X) = P^{A- A)" 1 f Sj, A G C \ M. 

R(-) is a canonical resolvent if and only if S) = fj. In this case R(X) = (A — A) -1 , A G C\R. 
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Theorem 2.14. Let Il a = {H ®Hi, T , Ti} be a boundary triplet for A* . If V = {t + ,t_} G 
Ra(Ho,Hi) is a collection of holomorphic pairs (2.3), i/ien for every g G and A G C \ R 
i/ie abstract boundary value problem 

(2.41) {/,A/ + . 9 }GA* 

(2.42) C (X)T {f,Xf + g}-C 1 (X)T 1 {f,Xf + g} = 0, A G C+ 

(2.43) Do(A)r {/,A/ + ff }-£) 1 (A)r 1 {/,A/ + 5 } = 0, A G C_ 

has a unique solution f = f(g, A) and the equality R(X)g := f(g, A) defines a generalized 
resolvent R(X) = R T (X) of the relation A. Conversely, for each generalized resolvent R(X) 
of A there exists a unique r G R a (Jto,'H\) such that R(X) = R T (X). Moreover, R T (X) is a 
canonical resolvent if and only if r G R%{Ho,H\). 

In the following corollary we reformulate the statement of Theorem 2.14 for parameters 
r of a special form. 

Corollary 2.15. Assume that H' and Hi are Hilbert spaces, Hi is a subspace in Hi and 
Il_ = {(H'®Hi)®Hi,T ,T 1 } is a boundary triplet for A* . If r = {t + ,t_} G R_i{H\,Hi) 
is a collection (2.3), then the direct statement of Theorem 2.14 holds with the following 
boundary conditions in place of (2.42) and (2.43): 

C (X)P n T {f, Xf + g} - C 1 (A)r 1 {/, A/ + g} = 0, A G C+ 

£>o(A)P^ro{/, Xf + g} - D 1 (X)T 1 {f, Xf + g} = 0, P w T {f, Xf + g} = 0, A G C_ 

Proof. Let f+(A) = {(C (A),Ci(A)),/C+}, A G C+, and f_(A) = {(D (X), Di(X)), W ® 
/C_}, A e C_, be holomorphic operator pairs with 

C (A) = C (A)P^ (G [W 8 Hi,JC+]), Ci(A) = d(A) (g [Hi,K+]) 

DoW = Pw + D (X)P ni (G [H'®Ui,U'®JC-]), £)i(A) = £»!(A))(G [Hi, W ® K-\). 

Then the direct calculations show that the operator functions Cj(-) and Dj(-), j G {0,1}, 
satisfy the relations (2.6)-(2.8), (2.10) and hence a collection f = {f+,f_} belongs to 
R-\{H' ®%\,%\). Applying now Theorem 2.14 to f we arrive at the desired statement. □ 

Remark 2.16. 1) For a = +1 definition of the boundary triplet II Q = II + and the correspond- 
ing Weyl functions M±(-) are given in the paper [33]. Moreover, the proof of Propositions 
2.7-2.9 and Theorem 2.14 for the triplets Il + is adduced in this paper as well (for the triplets 
II_ the proof is similar). 

2) If Ho = Hi := H, then the triplet IIq, turns into the boundary triplet (boundary value 
space) II = {"H, To, Til for A* in the sense of [16, 30]. In this case n+(A) = ri-(A) = dim"H, 
Aq{= kerTo) is a self-adjoint extension of A and according to [5, 30, 6] the relations 

(2.44) 7 (A) = m(T \ mx(A))- 1 , I\ [ 0T A (A) = M(X)T \ m x (A), X e p(A ) 

define the 7-field 7 (-) : p(A ) -> [U,fi] and the Weyl function M(-) : p(A ) -> [H] cor- 
responding to the triplet II. It follows from (2.44) that 7(-) and M(-) are associated 
with the operator functions 7±(-) and M±(-) from Definition 2.11 via 7(A) = 7±(A) and 
M(A) = M±(A), A G C±. Moreover, for such a triplet the identity (2.32) takes the form 

(2.45) M(/i)-M*(A) = (/i-A)7*(A)7(/i), ft AeC\K. 

Observe also that for the triplet II = {"H,r ,ri} all the results in this subsection were 
obtained in [5, 30, 6, 4]. 
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In what follows a boundary triplet II = {T-L,To,ri} in the sense of [16, 30] will be 
sometimes called an ordinary boundary triplet for A*. 

3. Decomposing boundary triplets for symmetric systems 

3.1. Notations. Let X = [a,b) (— oo < a < b < oo) be an interval of the real line (in the 
case b < oo the endpoint b may or may not belong to I), let H be a finite-dimensional Hilbert 
space, let AC(X; H) be the set of all functions /(•) : I — »■ M which are absolutely continuous 
on each segment [a,/3] C X and let AC (I) := AC(X;C). Denote also by Cj oc (X; [H]) the set 
of all Borel operator functions F(-) defined almost everywhere on X with values in [H] and 
such that j \\F(t)\\ dt < oo for each (3 G X. 

Next assume that A(-) G £j oc (X; [H]) is an operator function such that A(t) > a.e. on 

X and let C\(X) be the linear space of all Borel functions /(•) defined almost everywhere on 

X with values in H and such that / (A(i) / (i) , f (f))u dt < oo. Moreover, for a given finitc- 

i 

dimensional Hilbert space K. denote by £ A [/C,H] the set of all Borel operator-functions 

F(-) : 1 -> [/C,H] such that there exists the integral / F*(t)A(t)F(t) dt. It is clear that the 

i 

latter condition is equivalent to F(t)h G C\{I) for each h G K. 

As is known [22, 9] C\{1) is a semi-Hilbert space with the semi-definite inner product 
(•, -)a and semi- norm || • ||a given by 

(3.1) (f,g)A = J(A(t)f(t),g(t)) m dt, ||/||a = ((/,/)a)', f,geC 2 A (l). 

The semi-Hilbert space C\(I) gives rise to the Hilbert space L\(I) = C\(X)/{f G C\(I) : 
||/||a = 0}, i.e., L\{I) is the Hilbert space of all equivalence classes. The inner product 
and norm in L\(I) are defined by 

(f,9) = (f,g)A, H/ll = (/,/)' = II/I|a, f,geL 2 A (l), 

where / G f (g G g) is any representative of the class / (resp. g). 

In the sequel we systematically use the quotient map 7r from C\{I) onto L A (X) given 
by tt/ = f(3 /), / G Moreover, we let Sr = tt © tt : (£ A (X)) 2 -)• (ii(X)) 2 , so that 

Hf,g} = {f,g}, f,ge£i(i). 

3.2. Symmetric systems. In this subsection we provide some known results on symmetric 
systems of differential equations. 

Let as above I = [a, b) (— oo < a < b < oo) be an interval and let H be a Hilbert space 
with n := dimH < oo. Moreover, let B(-), A(-) G C\ oc (I\ [H]) be operator functions such 
that B{t) = B*(t) and A(t) > a.e. on I and let J G [H] be a signature operator ( this 
means that J* = J^ 1 = —J). 

A first-order symmetric system on an interval X (with the regular endpoint a) is a system 
of differential equations of the form 

(3.2) Jy'(t)-B(t)y(t) = A(t)f(t), t G I, 

where /(■) G C\{X). Together with (3.2) we consider also the homogeneous system 

(3.3) Jy'(t)-B(t)y(t) = XA(t)y(t), t G X, A G C. 

A function y G AC(X; H) is a solution of (3.2) (resp. (3.3)) if the equality (3.2) (resp. (3.3) 
holds a.e. on I. Moreover, a function Y(-,X) : X — > [tC, M] is an operator solution of the 
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equation (3.3) if y(t) = Y(t, X)h is a (vector) solution of this equation for each h G tC (here 
JC is a Hilbcrt space with dim/C < oo). 

Everywhere below we suppose that the system (3.2) is definite in the sense of the following 
definition. 

Definition 3.1. [14, 39, 24] The symmetric system (3.2) is called definite if for each A 6 C 
and each solution y of (3.3) the equality A(t)y(t) = (a.e. on I) implies y(t) — 0, t G I. 

As is known [39] the symmetric system (3.2) induces the maximal relations % nax in C\{I) 
and T max in L 2 A (Z), which are defined by 
(3.4) 

T max - {{y,f} G {C\{l)f : y G AC(X;U) and Jy'(t) - B(t)y(t) = A(t)/(t) a.e. on 1} 
and T max — rcTnax- Moreover the Lagrange's identity 

(3.5) {f,z) A - (y,g)A = [y,z]b - {Jy(a),z(d}), {y,f}, {z,g} G T max . 
holds with 

(3.6) [y, z] b := \im(Jy(t), z(t)), y,z G domT m ax- 

Formula (3.6) defines the boundary bilinear form [•, -]j on domTmax, which plays an essential 
role in our considerations. By using this form we define the minimal relations T m in in 
and T min in L\{1) via 

(3.7) T m in = {{?/, / } G T m ax ■ y(a) = and [y, z] b = for each z G douvTmax}- 

and T m in = nTmin- According to [39] T m in is a closed symmetric linear relation in L\(I) 
and T min = T m ax- 

For each A G C denote by N\ the linear space of all solutions of the homogeneous system 
(3.3) belonging to C\(I). Definition (3.4) of Tmax implies that 

■A/a = kcr (Tmax - A) = {y G C\{1) : {y, Ay} G Tmax}, A G C. 

and hence A/a C domTmax- 
Assume that 

n± := n±(T min ) = dim ^\(T min ), A G C±, 

are deficiency indices of T m j n . It is easily seen that irj\f\ — ^l\(T m i n ) and ker (ir \ A/a) = 
{0}, A G C. This implies that dimA/A = n±, A G C±. 
Let J G [H] be the signature operator in (3.2) and let 

v + = dim kcr (iJ — I) and V- = dim ker (i J + I). 

In what follows we suppose that 

(3.8) v := v- - u + > 0. 

In this case one can assume without loss of generality that the following statements hold: 

(i) the Hilbert space H is of the form 

(3.9) U = H(BH®H, 

where H and H are finite dimensional Hilbert spaces with 

(3.10) d\mH — v + , dimiJ = P; 

(ii) the operator J is of the form (1.3). 
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Introducing the Hilbert space 

(3.11) H = H®H 
one can represent the equality (3.9) as 

(3.12) M=(H®H)®H = H ®H. 

Let v b + and Vb- be indices of inertia of the skew-Hermitian bilinear form (3.6). Then 
fb± < oo and the following equality holds [2, 38] 

(3.13) n + = v + + v b+ , ra_ = i/_+z/ fc _. 
Therefore T m i n has equal deficiency indices n + = n_ if and only if 

(3.14) 9= v b+ - v b _. 

Observe also that according to [38, Lemma 5.1] there exist Hilbert spaces H b and Hb and a 
surjective linear map 

(3.15) T b = (r ofc : f fc : r 16 ) T : domT max -> U b © Hb © U b 
such that for all y, z e dom7^ OJ the following equality is valid 

(3.16) [y, z] b = i- sign (v b+ - v> b _)(T b y, Y b z) - (T lb y, T ob z) + (T ob y, T lb z). 
Moreover, for such a map T b one has kerTf, = ker [-,-] b and 

(3.17) dim"Hb = mm{i> b+ , u b -}, dim^ = \v b+ — v b -\. 

Recall that the system (3.2) is called regular if I = [a, b] is a compact interval and both 
the integrals J x \\B(t)\\ dt and J x ||A(i)|| dt are finite. For a regular system one can put 

H b = H, H b = H and Y b y = X b y(b), y 6 domf™,, where X b € [H] and X£ JX b = J. 

Next assume that X a e [H] is the operator such that X* JX a — J and let T a : AC(X: H) — > 
H be the linear map given by 

(3.18) T a y = X a y(a), y e AC7(Z;H). 

In accordance with the decomposition (3.9) T a admits the block representation 

(3.19) T a = (r 0a : f a : T la ) T : AC(2; H) -> H © H © H. 

The particular case of the operator X a is (cf. [20] ) 

(Xqo Xoi\ 
I \:H®H®H^H®H®H, 
X w In/ 

where the entries Xjk satisfy 

TmiXooX^) = 0, Im(X w X* 1 ) = 0, -X 10 X^ + X U X* = I H . 

If X a is given by (3.20) and the function y e AC(T; H) is decomposed as 

y(t) = {yo(t), y(t), yi(t)}(€ H®H®H), teX, 

then in the representation (3.19) one has 

(3.21) T 0a y = X 00 y (a) + X m{a), f a y = y(a), T la y = X 10 y (a) + Xuy^a). 
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Let A G C. By using the operator X a we associate with each operator solution Y(-, A) : 
X — > [/C, HI] of the equation (3.3) the operator Y a (\) G [/C,H] given by 

(3.22) Y a (\) = X a Y(a,X) 
(recall that here K. is a finite-dimensional Hilbert space). 

Lemma 3.2. 1) IfY(-,X) G £^[/C,H] is an operator solution of Eq. (3.3), then the relation 

(3.23) K,3h^ (Y(\)h)(t) = Y(t, X)h G A/a- 

defines the linear map Y(\) : K, — > N\ and, conversely, for each such a map Y{\) there exists 
a unique operator solution Y(-, A) G £^[/C,H] of Eq. (3.3) such that (3.23) holds. 

2) Let Y(-,X) G C\[K,,W]J>e an operator solution of Eq. (3.3) and let F(X) = ttY(X)(g 
[K, L\{I))). Then for each / G L\{1) 

(3.24) F*(\)f = ^Y*(t,\)A(t)f(t)dt, fej. 

The first statement of this lemma is obvious, while the second one can be proved in the 
same way as formula (3.70) in [35]. 

Clearly, for each solution Y(-, A) G C\[K,,M\ of Eq. (3.3) the operator (3.22) admits the 
representation 

(3.25) Y a {\) = T a Y{\), 
where Y(\) is defined in Lemma 3.2. 

Remark 3.3. According to [38, Remark 5.2] one can construct the map Tb by using the 
following assertion: 

- there exist systems of functions {V'jliN {<Pj}i b an d {9j}i b in dom7^iaa; with Vb — 
min{i^b + , Vb-} and Ob = \vb+ — ^t-l such that the operators 

(3.26) T Qb y = {[y,i, j ]bY 1 b , f b y = {[y, <pj] b }? , T lb y = {[y, 9^}?, yedomT™, 

form the surjective linear map r b = (r ob : f fc : ri h ) T : domT^ ->• ffi C b 
satisfying the equality (3.16). 

This assertion shows that Tby is, in fact, a singular boundary value of a function y G 
domT max (cf. [9, Ch. 13.2]). 

3.3. Decomposing boundary triplets. As is known (see for instance [29]) the maximal 
relation T max induced by the definite symmetric system (3.2) possesses the following prop- 
erty: for each {y, /} G T max there exist a unique function y G AC(X;M) n C\(I) such that 
y G y and {y, /} G Tmax for each / G /. Below, without any additional comments, we 
associate such a function y G AC {I; H) D C\{I) with each pair {y, /} G T max . 

Let as before Tb and T a be the operators (3.15) and (3.19) respectively and let Ho be the 
Hilbert (3.11). Consider the following three alternative cases: 

Case 1 : Vb+ — Vb- > v~ — v + > 0. 

It follows from (3.17) that in this case 

(3.27) dim'Hf, = v b _, dim^f, = v b+ - v h _ 

and (3.10) gives dim "Kb > dimiJ. Therefore without loss of generality we can assume that 
H cH b and hence 

(3.28) H b = H' 2 ®H 



18 SERGIO ALBEVERIO, MARK MALAMUD, AND VADIM MOGILEVSKII 

with H' 2 =H b Q H. Let H b =H b ® H' 2 (so that H b C H b ) and let 

(3.29) f ob = To b + Pn'T b :domT max ^'Hb 
In Case 1 we put 

(3.30) Ho = H © H b , Hi = Ho® H b , 

T'o = \ Tla + % a ~ PsTb) ) : domT max -+ Ho © H b , 

(3.31) V i i oh ^ / 

ri = ( r °° + ^ + P £ r ^ : domT m(K ifo © «6, 

If in addition n + = n_, then in view of (3.14) and (3.17) H b = H and = {0}- Therefore 

(3.32) H b = H b , To b = r b 
and the equalities (3.30) and (3.31) take the form 

(3.33) H = H ®H b (:=H =Hi), 

f3 34) K = (-T la + i(f „ - f b ) : T Qb ) T : domT^ -> #o © H b , 

ri = (r 0a + |(f a + f 6 ) : -r lfc ) T : domT max -^H ® H b . 

Case 2 : V- — v + > v b+ — v b _ > 0, 
so that the equalities (3.27) holds. It follows from (3.10) that in this case dimH > dimHfc. 
Therefore one may assume that H b C H and hence H — H b (BH' 2 with H' 2 — H © H b . This 
implies that the Hilbert space (3.11) admits the representation 

(3.35) H = H@H b @H' 2 = H' Q @H' 2 , 

H 

where 

(3.36) H' a = H®H b . 
In Case 2 we let 

(3.37) H Q = H' @H' 2 @H b , H 1 = H' @H b , 

/-r la + i(P nj r a -r b )\ 

T'o = iP H , Y a ■ doxaT max ->• H Q @H' 2 @ H b , 

(3.38) V r 2 t ^ / 

Ti = ( r ° a + 2 + r&) ) : domT mal -»■ H © H 6 . 

Case ff : v > > ^ + — z^,_ and P ^ v b+ — v b -(^ 0), 
so that in view of (3.17) 

(3.39) divaH b = v b+ , dim H b = v b _ - v b+ . 

Let H b := H b (BH b (so that H b C "H&) and let r 6 : domT^iaa; — > H b be the linear map given 

by 

(3.40) f 06 = r ofc + f b . 
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In Case 3 we put 

(3.41) H Q = H ®H ®U b = H (SH b , H 1 =H@H b , 

(3.42) r o = ^ 2 J a j : dom T m a X ^H®H®H b , T[ = (^r^) : dom ^ ax H ®H b . 

Note that for evrey system (3.2) one (and only one) of Cases 1-3 holds. In each of these 
cases Hi is a subspace in Ho and 1^- is a linear map from domTmax to Hj, j G {0-1}- 
Moreover, the subspace H2 = Ho ©Hi coincides with H' 2 in Cases 1-2 and H2 = HffiH& in 
Case 3. Observe also that according to [38, Proposition 5.5] the deficiency indices of T min 
are n± = v± + v b ±. Therefore n_ < n + in Case 1 and n + < n_ in Cases 2 and 3. Moreover, 
formulas (3.10), (3.27) and (3.39) imply that in all Cases 1-3 

(3.43) dim Ho + dim Hi = v + + v_ + v b+ + Vb- = n + + n_. 

Proposition 3.4. Let Hj be Hilbert spaces and V- : dom Tmaz — > Hj, j £ {0,1}, be 
linear mappings constructed for the alternative Cases 1-3 before the proposition and let 
Tj : T max — > Hj, j G {0, 1}, be the operators given by 

(3.44) T {yJ} = T' Q y, ^i{y, /} = T'iJ/, {yJ}eT max . 

Then the collection U a = {Ho ©Hi,r ,ri} with a = +1 in Case 1 and a = — 1 in Cases 2 
and 3 is a boundary triplet for T max . 

If in addition n + = n_ (so that Case 1 holds), then U + turns into an ordinary boundary 
triplet n = {H,r ,ri} for T m axr where H is the Hilbert space (3.33) and Tj : T max > 
H, j G {0, 1}, are the operators given by (3.44) and (3.34). 

Proof. The immediate calculations with taking (3.16) into account show that in each of the 
Cases 1-3 the operators T' and T[ satisfy the relation 

[y, z] b - (Jy(a), z(a)) = (T\y, T' z) - (T' y, T[z) + ia(P 2 T' y, P 2 T' z), y, z e domT max - 

This and the Lagrange's identity (3.5) give the identity (2.21) for the operators r and 
Ti defined by (3.44). To prove surjectivity of the mapping V = (Tq : Ti) T note that 
ker T' Q n ker T[ = kerr a n ker Tb = domTmm. Hence kerT(= ker T n ker Ti) = T min and by 
using (3.43) one obtains 

dim(domr/kcrr) = dim(T max /T mln ) = n + + n_ = dim(H © Hi). 

This implies that ranT = Ho © Hi and, consequently, n a is a boundary triplet for T max . 
The latter statement of the proposition follows from reasonings before formula (3.33). □ 

Definition 3.5. The boundary triplet II Q = {Ho © Hi, To, Ti} constructed in Proposition 
3.4 will be called a decomposing boundary triplet for T max . 

Remark 3.6. In the paper [38] decomposing boundary triplets 11+ were constructed for the 
maximal relations T max satisfying the condition n_ < n + . In Case 1 such a triplet coincides 
with the triplet II + introduced in Proposition 3.4. 

Combining Propositions 3.4 and 2.12 we arrive at the following three propositions. 

Proposition 3.7. Let in Case 1 H + = {Ho ©Hi, T , Ti} be a decomposing boundary triplet 
(3.31), (3.44) forT max . Then: 
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1) The equalities 

(3.45) T = {{y, /} G T max : T la y = 0, T a y = P s f b y, f ob y = T lb y = 0} 

(3.46) T* = {{y, /} G T max : T la y = 0, f a y = P a ? b y} 

define a symmetric extension T of T min and its adjoint T* . Moreover, the deficiency indices 
of T are n + (T) = v b+ — v and n_{T) = v b _. 

2) The collection n + = {H b H b ,T ,Ti} with the operators 

(3.47) t {y,f} = T ob y, f ,{y, /} = -T lb y, {yJ}eT*, 

is a boundary triplet for T* and the (maximal symmetric) relation A (= kcrTo) is of the 
form 

(3.48) A = {{y, /} G T max : T la y = 0, f a y = P s ? b y, f ob y = 0}. 

If in addition n + = n_ and U = {"H,r ,ri} is an ordinary decomposing boundary triplet 
(3.34), (3.44) forT max , then the equality (3.45) take the form 

(3.49) T = {{y, 7} G T max : T la y = 0, f a y = f b y, T ob y = T lb y = 0} 
and n + (T) = n_(T) = v b _. Moreover, in this case A n = A* Q and 

(3.50) A = {{y, 7} G T max : T la y = 0, f a y = f b y, T ob y = 0}. 

Proposition 3.8. Let Case 2 holds and let II_ = {Ho ®'Hi,ro,ri} be a decomposing 
boundary triplet (3.38), (3.44) forT max . Then: 

1 ) Statement 1 ) of Proposition 3. 7 holds with 

(3.51) T = {{y, 7} £ T max : T la y = 0, T a y = T b y, T ob y = T lb y = 0} 
(3-52) T* = {{y, 7} G T max : T la y = 0, P^T a y = f b y}. 

Moreover, the deficiency indices of T are n+(T) = v b - and ra_(T) = 9 + 2v b - — v b +. 

2) The collection II = {(H' 2 ®H b ) ®H b -,To,V\} with the operators 

(3.53) t {yj} = {iP n ,T a y,r 0b y}(€U' 2 ®U b ), f \{y J} = -I \ b y{& H b ) , {yJ}eT*, 
is a boundary triplet for T* and Aq(= kerTo) is of the form 

(3.54) A = {{y, 7} G T max : T la y = 0, f a y = f b y, T ob y = 0}. 

Proposition 3.9. Let in Case 311- = {Ho ®Hi, To, Ti} be a decomposing boundary triplet 
(3.42), (3.44) forT max . Then: 

1 ) Statement 1 ) of Proposition 3. 7 holds with 

(3.55) T = {{y, 7} G T max : T la y = 0, f a y = 0, f ob y = T lb y = 0} 

(3.56) T* = {{y, 7} £ T max : T la y = 0}. 

Moreover, the deficiency indices ofT are n + (T) = v b+ and n_(T) = v + v b -. 

2) The collection II_ = {(H ®H. b ) ©^6,ro,ri} with the operators 

(3.57) t {yJ} = {iT a y,T ob y}(£H(BH b ), t 1 {yJ} = -T lb y(eH b ), {yJ}eT*, 
is a boundary triplet for T* and Aq{= kerTo) is of the form 

(3.58) A Q = {{y, f} G T max : T la y - 0, f a y = 0, f ob y = 0}. 
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4. /^-SOLUTIONS OF BOUNDARY VALUE PROBLEMS 

4.1. Case 1. Assume that in Case 1 Ii + = {Ho ©%i,ro,ri} is a decomposing boundary 
triplet (3.31), (3.44) for T max and r = {r + , t_} G R + i(Hb, lib) is a collection of holomorphic 
pairs (2.3). For a given / G £^(X) consider the following boundary value problem: 

(4.1) Jy' -B(t)y = XA(t)y + A(t)f(t), tel, 

(4.2) T la y = 0, f a y = P s f b y, C (X)f ob y + C 1 {X)T lh y = 0, A e C+, 

(4.3) r la y = 0, r a y = P s T b y, D (\)f ob y + D^T^y = 0, A G C_. 

A function y(-, •) : I x (C \ R) — >• H is called a solution of this problem if for each A G C \ R 
the function y(-, A) belongs to AC (I; H) n C\(I) and satisfies the equation (4.1) a.e. on I 
(so that y G domT ma x) an d the boundary conditions (4.2), (4.3). 

Application of Theorem 2.14 to the boundary triplet (3.47) yields the following theorem. 

Theorem 4.1. Let in Case 1 T be a symmetric relation in L\(I) defined by (3.45). If 
t = {t + ,t_} G R + i(H b ,'H b ) is a collection (2.3), then for every f G C\{T) the boundary 
problem (4.1) - (4.3) has a unique solution y(t, A) = y/(t, A) and the equality 

(4.4) R(X)f = n(y f (;X)), f G L 2 A (1), f e /, AgC\M, 

defines a generalized resolvent R(X) =: R T {X) of T . Conversely, for each generalized resol- 
vent R(X) ofT there exists a unique r G R + i(7I b ,H b ) such that R(X) = R T (X). 

If n + = ri- , then (3.32) is valid. This and Theorem 4.1 yield the following corollary. 

Corollary 4.2. Let n + = n_, let U = {H, T , Ti} be a decomposing boundary triplet (3.34), 
(3.44) for T max and let T be a symmetric relation (3.49). Then the statements of Theorem 
4-1 hold with the Nevanlinna operator pairs r G R(H b ) in the form (2.16) and the following 
boundary conditions in place of (4.2) and (4.3): 

(4.5) r lQ y = 0, T a y = T b y, C (X)T ob y + C 1 (A)r 162/ = 0, A G C \ R. 
In this case R T (X) is a canonical resolvent of T if and only if r € R°(H b ). 

Remark 4.3. Let in Theorem 4.1 r = {t + ,t_} G R + \{% bl H b ) be defined by (2.3) with 

(4.6) Co(A)=/^, C7x(A)=0 and D (A) = P Ub {& [U b ,U b ]), D 1 (X)^0 
and let Ro(X) = R To W be the corresponding generalized resolvent of T. Then 

i?o(A) = (A - X)-\ A G C+ and R (X) = (A* - A)" 1 , A G C_, 

where Aq is given by (3.48). 

Similarly, let in Corollary 4.2 r = {{I Hb , 0); U b } G R°{H b ). Then R (X) := R To (X) = 
(A — A) -1 , where A is the selfadjoint extension (3.50). 

Proposition 4.4. Let in Case 1 W + = {Ho ©"Hi, To, Ti} 6e a decomposing boundary triplet 
(3.31), (3.44) for T max , let 7±(-) &e f/ie corresponding 7 -fields and let 

(4.7) M + W-(m 3 ° + % M^A))^ 00 ^^^ ^' AGC+ 

(4.8) ^-(A) = (^ 3 °_ ( ^ J;;{|:ffoe%^oe%, AGC_ 

6e t/ie 6?ocfc representations of the corresponding Weyl functiions. Then: 
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1) For every AeC\t there exists an operator solution Vq{-,\) £ C\[H ,M] of Eq. (3.3) 
such that 

(4.9) r la vo(X) = -P H , AeC\K, 

(4.10) (T 0a + f a )v a (X)=m (X)-^P s , AeC\K, 

(4.11) i{T a -P s T b )v {\) =P S , AeC\K, 

(4.12) f 06 t, (A)=0, T lb v (X) = -M 3+ (A), A £ C+, 

(4.13) T ob v (X) = -iP n , 2 M 3 _(X), T lb v (X) = -P„ 6 M 3 _(A), X e C_. 

2) For every X £ C + (A £ C_) t/iere exists a solution u + (-,X) £ £^[7^6,11] (resp. 
U-(-,X) £ £^[H h ,H]j sucft that 

(4.14) r lo «±(A) = 0, A £ C±, 

(4.15) (r 0a + f„)u±(A) = M 2± (A), A £ C±, 

(4.16) i(T a -P s f b )u±(X) =0, A£C±, 

(4.17) r 6U+(A) = J^, r 16 n+(A) = -M 4+ (A), A £ C+, 

(4.18) Y ob u-{X)=I Ub -iP-H'M i -{X), r lfe n_(A) = -P m M 4 _(A), A £ C_. 

In formulas (4.9)- (4.18) v {X) and u±(X) are linear maps from Lemma 3.2 corresponding 
to the solutions v$(-,X) andu±(-,X) respectively. 

3) The solutions v (-, A) and u±(-, A) are connected with j-fields 7±(-) by 

(4.19) 7± (A) \H =itv (X), A£C±; 

(4.20) 7+ (A) \U b = wu+(X), A£C+; 7 _(A) r U b = 7ru_(A), A £ C_. 

Proof. Let 7 ±(-) be the 7-fields (2.25) of the triplet II + . Since the quotient mapping 7r 
isomorphically maps M\ onto %l\{T m i n ), it follows that for every A £ C + (A £ C_) there 
exists an isomorphism Z + (X) : Ho — > Af\ (resp. Z_(X) : Hi — > TVa) such that 

(4.21) 7+ (A) =nZ+(X), A £ C+; 7 _(A) = nZ_(X), X £ C_. 

Combining of (4.21) with (2.25) - (2.27) and the obvious equality Tj{ny, Xiry} = T'jy, y £ 
Af\, j £ {0,1}, gives 

(4.22) T' Z + (X) = I no , T[Z + (X) = M+(X), A £ C+, 

(4.23) P Hi r'oZ-(X) =I Hl , (T' 1 +iP w T' )Z_(X)=M_(X), X £ C_, 
which in view of (3.31) can be written as 

(4.24) f- r '« + i ff»- P S f ^Z + (A)=(^ j°J. A£C + 

,4, 5 , ( r - + ^;^»)^,-(-« &$).*^ 

(4.26) ft 1 " + z f a - P S fb A Z_ (A) = ft" ° V A £ C_ 

V r ofc / V u 

,4071 /r 0a + I(r o + P d f 6 A f m (X) M 2 _(A)\ 

(427) -r 16 + iJW 6 J Z -W-Ua-(A) M 4 _(A)J' AGC - 
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It follows from (4.24)-(4.27) that 

(4.28) r lo Z±(A) = {-P H ■ 0), ±(f - P A T b )Z ± (X) = (-±P S : 0), A e C± 

(4.29) r 0Q Z±(A) = (P H m (X) : P H M 2± (A)), A G C± 

(4.30) ±(f „ + Pgf 6 )Z±(A) = (Pgm (A) : P g M 2 ±(A)), A G C±. 
Summing up the second equality in (4.28) with (4.29) and (4.30) one obtains 

(4.31) (r 0a + f a )Z±(\) = (m (A) - fPg : M 2± (A)), A G C±. 
Moreover, (4.24)-(4.27) yield 

(4.32) f ob Z + (\) = (0 : r lfc Z+(A) = (-M 3+ (A) : -M 4+ (A), A e C+, 

(4.33) r 16 Z_(A) = (-P Hi ,M 3 _(A) : -Ph 6 M 4 _(A), A e C_, 

r 06 Z_(A) = (0 : J W J, P^f 6 Z_(A) = (-iP^M 3 _(A) : -iP^ M 4 _(A)), A e C_ 
and in view of (3.29) one has 

(4.34) f ob Z_(X) = (-iP w ,M 3 _(A) : I Hb - iP^M 4 _(A)), A G C_. 
Assume now that the block representations of Z±(\) are 

(4.35) Z + (\) = {v (X):u + (\)):H ®H b ^Afx, A G C+ 

(4.36) Z_(A) = («o(A):«_(A)):H eW6->JVA, A G C_ 

and let v (-, A) G £|[H ,H], u+(-,A) G £^ [74,11] and «_(■, A) G £ 2 A [H b ,B] be the operator 
solutions of Eq. (3.3) corresponding to t>o(A), it+(A) and u_(A) respectively (see Lemma 
3.2). Then the representations (4.35) and (4.36) together with (4.28), (4.31) and (4.32) - 
(4.34) yield the relations (4.9)-(4.18) for v {-, A) and u±(-, A). 

Finally, (4.19) and (4.20) follow from (4.21) and (4.35), (4.36). □ 

Theorem 4.5. Let the assumptions of Proposition 4-4 be satisfied and let t = {t+,t_} G 
R+i(T-L b ,'H b ) be a collection of operator pairs (2.3). Then: 

1) For each AeC\R there exists a unique operator solution v T (-,X) G £^[#0,11] of Eq. 
(3.3) satisfying the boundary conditions 



(4.37) T la v T {X) = -P H , AeC\M, 

(4.38) i(T a -P s r b )v T (\)=P S , A e C \ K, 

(4.39) C (\)r ob v T (\) + dWTuVriX) =0, A G C+, 

(4.40) D (X)f ab v T (X) + Di(A)ri 6 « T (A) =0, A 6 C_ 

(here Ph and Pg are the orthoprojectors in Hq onto H and H respectively). 

2) v T (-,X) is connected with the solutions vq(-,X) and u±(-,X) from Proposition 4-4 by 

(4.41) v T (t,X) = v Q (t,X)-u + (t,X)(T + (X)+M i+ (X))- 1 M 3+ (X), A G C+ 

(4.42) v T (t,X)=v Q (t,X)-u-(t,X)(Tl(X) + M i -(X))- 1 M 3 -(X), A G C_. 



If in addition n + = n_ and U = {%,ro,ri} is a decomposing boundary triplet (3.34), 
(3.44) forT max , then t G R{% b ) is given by (2.16) and the boundary conditions (4.37)-(4.40) 
take the form 

T la v T (X) = -P H , i(T a -T b )v T (X)=P s , C (A)r 06 « T (A)+C 1 (A)r lb « T (A) -0, AeC\M. 
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Proof. Since in view of Proposition 3.7, 2) M 4 ±(-) are the Weyl functions of the boundary 
triplet it follows from [33] that G p(r+(A) + M 4+ (A)), A G C+, and G p(t£(A) + 
M 4 _(A)), A G C_. Therefore for each A G C \ R the equalities (4.41) and (4.42) correctly 
define the solution v T (-, A) G £^[i?o, H] of Eq. (3.3). Let us show that this solution satisfies 
(4.37)-(4.40). 

Combining (4.41) and (4.42) with (4.9), (4.11) and (4.14), (4.16) one gets the equalities 

(4.37) and (4.38). Jo prove (4.39) and (4.40) we let T+(A) = (r+(A) + M 4+ (A))-\ A G C+, 
and T_(A) = (r* (A) + M 4 -(A))-\ A G C_. Then 

(4.43) r+(A) = {{T+(X)h, (I - M 4+ (X)T+(X))h} : h E H b } 

and rJ.(A) = {{T_(A)/i,/i- M 4 _(A)T_ (X))h} : h G "H 6 }, which in view of (2.11) yields 

(4.44) r_(A) = {{(-T_(A) -iP wi +»P wi M 4 _(A)T_(A))/i, 

(-i^ + Pw 6 M 4 _(A)T_(A))M : ft G iL b }. 

Moreover, the relations (4.41) and (4.42) with taking (4.12), (4.13), (4.17) and (4.18) into 
account give 

f ah v T X = -T+(A)M 3 +(A), T lh v T X = -(I - M 4+ (A)T + (A))M 3 +(A), A G C+, 
IWvA = (-iP H , 2 -T_(X)+iP W2 M 4 _(X)T_(X))M 3 _(X), X G C_, 
T lh v T X = {-P Hb + P Wi ,M 4 _(A)T_(A))M 3 _(A), A G C_ 
Hence by (4.43) and (4.44) one has 

(4.45) {f ob v T (X)h ,T lb v r (X)h } e r±(A), h eH , XeC ± , 

which in view of the equalities (2.3) yields (4.39) and (4.40). 

Next assume that vi(-, A) G C\[H , H] and V2(-, A) G C\[H , H] arc the operator solutions 
ofEq. (3.3) satisfying (4.37)-(4.40) and let v(t, A) = v\{t, X)—v 2 (t, A). Then for each h E H 
the function y = v(t,X)ho is a solution of the homogenous boundary problem (4.1)-(4.3) 
(with / = 0). Since by Theorem 4.1 such a problem has a unique solution y = 0, it follows 
that v(t, A) = 0. This proves the uniqueness of v T (-, A). □ 

4.2. Case 2. Applying Corollary 2.15 to the boundary triplet (3.53) we obtain the following 
theorem. 

Theorem 4.6. Let in Case 2 Il_ = {%$ ® T-Li,Tq,Ti} be a decomposing boundary triplet 

(3.38) , (3.44) for T max , let T be a symmetric relation in L\(I) defined by (3.51) and let 
t G R(H b ) be a Nevanlinna operator pair (2.16). Then for every f G C\{I) the boundary 
value problem 

(4.46) Jy' -B(t)y = XA(t)y + A(t)f(t), tel, 

(4.47) T la y = 0, P n T a y = f h y, C (X)T ob y + d(X)r lb y = 0, A G C+, 

(4.48) T la y = 0, T a y = r b y, C Q (X)T Qb y + C^X^y = 0, A G C_. 

has a unique solution y(t,X) = yf(t,X) (in the same sense as the problem (4.1)-(4.3)J and 
the equality (4.4) gives a generalized resolvent R(X) =: R T (X) of T . 

Remark 4.7. Let in Theorem 4.6 r = {{In b i 0); Hb} G R (H b ) and let A) be the symmetric 
extension (3.54). Then Ro(X) := R To (X) is if the form 

(4.49) Rq(X) = (A* - A)" 1 , A G C+ and R (X) = (A - A)" 1 , A G C_, 
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Proposition 4.8. Assume that in Case 211- = {Ho®Hi,T , Ti} is a decomposing boundary 
triplet (3.38), (3.44) forT max , 7±(-) are the j-fields of II- and 

/Mi (A) M 2 (A)\ 

(4.50) M+(A) = JV 1+ (A) 7V 2+ (A) :ff>%^I>^e%, A G C+ 

\M 3 (A) M 4 (A)/ 

(4.51) M_(A) = (^gj ^j):^e^em^^em, a,c_ 

are i/ie &Zocfc representations of the corresponding Weyl functions. Moreover, let mo(-) : 
C \ R — > [i?o] &e operator function given by 

(4.52) m o( A)-^ Ml ( A ) ° 



(4.53) m (A) = 



JVi+(A) 
Mi (A) 7V!_(A) 




T/ien: I) for every A G C \ R there exists an operator solution v (-, A) G C\[H ,M] of Eq. 
(3.3) such that (4.9) anii (4.10) hold and 

(4.54) i(P^f -f 6 )wo(A) = P^, AeC+; i(f a - f 6 )«o(A) = P s , A e C_, 

(4.55) r 06 w (A)=0, A G C \ R, 

(4.56) r 16 «o(A) = -M 3 (A)Pfl-/, AgC+; T lb v (X) = (-M 3 (A) : -JV 2 _(A)), A G C_ 

Cm (4.56) Pjj/ is £/ie orthoprojector in H onto H' ). Moreover, for every A G C \ R there 
exists a solution u(-,X) G jC\[H b ,M] of Eq. (3.3) suc/i i/iai 

(4.57) ri o u(A)=0, AgC\R, 

(4.58) (r „+f a )u(A) = M 2 (A) + 7V 2+ (A), A G C+; (r 0a + f a )«(A) = M 2 (A), A G C_ 

(4.59) i(P^T a -f b )u(X)=0, AgC+; i(f „ - f 6 )u(A) = 0, A G C_, 

(4.60) r ob u(X)=I Hb , T lb u(X) = -M 4 (A), AgC\R. 
,2) TTie following equalities hold 

(4.61) 7 _(A) ttf =™ (A), A G C_; 7± (A) t % - ™(A), A G C±. 

Proof. 1) By using the reasonings from Proposition 4.4 to the 7-fields (2.33) of the triplet II 
one can prove that for every A G C+ (A G C_) there exists an isomorphism Z + (X) : Hi — > Af\ 
(resp. Z-(X) : Ho — > Af\) such that (4.21) holds and the relations 

(4.62) P ni T' Z + (X) = (T' 1 -iP n ,T )Z + (X)=M + (X), X e C+, 

(4.63) KZ-(X) =I Ho , r' 1 Z_(A) = M_(A), A G C_. 
are valid. In view of (3.38) the equalities (4.62) can be represented as 

(4.64) (- ri ° + • - ^ Z+ (X) = ( 7 J j A e c+ 

/r a + H P H?a + T b )\ ( M^X) M 2 (A) \ 

(4.65) P n ,T a Z + (X) = N 1+ (X) N 2+ (X) , A G C+ 
V -r 16 / \M 3 (A) M A {X)J 
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Therefore for all A 6 C+ one has 

(4.66) T la Z + {\) = (-P H : 0), ±(P^f a - f b )Z + (X) = (-fP^ : 0), 

(4.67) T aZ+(X) = {PhM^X) : P H M 2 {X)), 

(4.68) \{P q T a +f b )Z + {X) = (P^Mi(A) : P^M 2 (A)), 

(4.69) P w T a Z + {\) = (N 1+ (X) : N 2+ (X)). 

Moreover, summing up the second equality in (4.66) with the equalities (4.67), (4.68) and 

(4.69) one gets 

(4.70) (T a + T a )Z+(X) = (Mi (A) + N 1+ {X) - |P^ : M 2 (A) + N 2+ (X)) :H' ®U b ^ H . 
Next, by using (3.38) we may rewrite the equalities (4.63) as 

/-r l0 + i(P£ f -f 6 )\ 

(4-71) I lPw Y a U_(A) = 

U72) (T 0a + l{P n T a + f b )\ ( Ml (X) Nx-(X) M 2 (A)\ 

(4J2) I -r 16 ) Z - {X) - [m 3 (x) n 2 .(x) M 4 (A)J' AeC - 

In view of (3.37) and (3.35) one has 

(4.73) H = H ®H b . 

Let T_(X) G [Hq, H' a ] be the operator given by the block representation 

(4.74) T_(A) = (Mi (A) : JVi_(A)) : H' ®H' 2 ^ H' , X e C_. 

It follows from (4.71) and (4.72) that in the decomposition (4.73) of "Ho the following equal- 
ities hold for all A E C_: 

(4.75) T la Z_(A) = (-P H : 0), ±(P^f a - f 6 )Z_(A) = (-|P^ : 0), 

(4.76) P^f a Z_(A) = (-iP n : 0), T 0a Z_(X) = (P H T_(X) : P ff M 2 (A)), 

(4.77) ±(P^f a + f 6 )Z_(A) = (P~ T_(A) : P^M 2 (A)), 

Multiplying the second equality in (4.75) by 2 and summing up with the first equality in 
(4.76) we obtain 

(4.78) (f„ - f 6 )Z_(A) = -i(P s : 0), A G C_. 

Moreover, summing up the second equality in (4.75) with the equalities (4.76) and (4.77) 
one gets 

(4.79) (r 0a + f a )Z_(A) - (T_(A) - I P^ - iP H ' 2 ■ M 2 (A)), A 6 C_. 
Assume now that 

(4.80) Z+(X) = (r(A) : u(A)) : H' Q @ H b ^ Af x , X e C+ 

(4.81) Z_{X) = (vo(X):u(X)):H ®H b ^Afx, A e C_ 

are the block representations of Z±(A) (in (4.81) we make use of the decomposition (4.73) 
of Ho). Moreover, let 

(4.82) «q(A) :=(r(A) : 0) : H' ®U' 2 ^ N x , X e C+. 
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Then the equalities (4.81) and (4.82) define the linear mapping Vo(X) : Ho — > A/a, while 

(4.80) and (4.81) give the mapping u(X) : Tib — > Af\- Next we show that the operator 
solutions v (-,X) G £ 2 A [H ,W] and u(-,A) G C A [H b ,M] of Eq. (3.3) corresponding to v (X) 
and u(X) in accordance with Lemma 3.2 have the desired properties. 

Combining (4.80)-(4.82) with (4.66), the first equality in (4.75) and (4.78) we obtain (4.9) 
and the relations (4.54), (4.57) and (4.59). Moreover, in view of (4.52), (4.53) and (4.74) 
one has 

mo(A) - |P fi - (Mi (A) + N 1+ (X))P H < + fP„, - |(P^ + P Wa ) = 
(Mi (A) + JV 1+ (A) - iPfi b )PH>, AgC+, 
m (A) - iP fi = T_(A) - 'P w , - i(P^ + P„, ) = T_(A) - |P^ - , A G C_. 

Combining these equalities with (4.70), (4.79) and taking the block representations (4.80)- 

(4.82) into account one gets the equalities (4.10) and (4.58). Finally, the relations (4.55), 
(4.56) and (4.60) are implied by the block representations (4.80)- (4.82) and the equalities 
(4.64), (4.65) and (4.71), (4.72). 

2) The equalities (4.61) are immediate from (4.21) and the block representations (4.80), 

(4.81) . □ 

Theorem 4.9. Let the assumptions of Proposition 4-8 be fulfilled and let r = r(A) G R{(H b ) 
be a Nevanlinna operator pair (2.16). Then: 

1) The statement 1) of Theorem 4-5 holds with the boundary condition (4.37) and the 
following boundary conditions instead of (4. 38) -(4.40): 

(4.83) i{P n ? a -? b )v T (X) =P£ 6 , AgC+; i(f a -f b )v T {\)=P s , X G C_ 

(4.84) C (A)r 06 « T (A)+C 1 (A)r lb « T (A)-0, AgC\R 

(here P^ b (PgO is the orthoprojector in Ho onto Hb (resp. H) in accordance with the 
decomposition (3.35)J; 

2) the operator function v T (-,X) can be represented as 

(4.85) v T (t,X) =v (t,X)-u(t,X)(T(X)+M i (X))- 1 M 3 (X)P H ,, X e C+, 

(4.86) v T (t,X) =v {t,X) -u(i,A)(r(A) + M 4 (A))- 1 5_(A), A G C_, 
where Vo(t, A) and u(t,X) are defined in Proposition 4-8 and 

(4.87) S_(A) := (M 3 (A) : A^ 2 _(A)) A G C_. 

Proof. Let us show that the solution v T (-, A) defined in (4.85) satisfies the boundary condi- 
tions (4.37), (4.83) and (4.84). Combining (4.85) with (4.9), (4.54) and (4.57), (4.59) one 
obtains the relations (4.37) and (4.83). Similarly, the relations (4.55), (4.56) and (4.60) give 

r ob v T (X) - -(r(A) + M 4 (A))- 1 M 3 (A)P w;) , A G C+, 

ri 6 w T (A) = (-/ + M 4 (A)(r(A) +M 4 (A))- 1 )M 3 (A)P w;) , A G C+, 

TobV T (X) - -(t(A) + M 4 (A))" 1 5_(A), A G C_, 

T lb v T {X) = (-/ + M 4 (A)(r(A) + M 4 (A))- 1 )^_(A), A G C_. 

Hence {T ab v T (X)h , T lb v T (X)ho} G t(A), h G Hq, X G C\R, which yields (4.84). Finally, by 
using Theorem 4.6 one proves uniqueness of v T (-, A) in the same way as in Theorem 4.5. □ 
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4.3. Case 3. Application of Corollary 2.15 to the boundary triplet (3.57) gives the following 
theorem. 

Theorem 4.10. Let in Case 3 II _ = {TLo © 'Ri^o^i} be a decomposing boundary triplet 
(3.42), (3.44) for T max , let T be a symmetric relation (3.55) and let t = {t + ,t_} G 
R-i(Hb,Hb) be a collection of holomorphic operator pairs (2.3). Then for every f G C\{I) 
the boundary value problem 

(4.88) Jy'-B(t)y = XA(t)y + A(t)f(t), i e X, 

(4.89) T la y = 0, Co(A)f o6 y + Ci(A)r lfc y = 0, A G C+, 

(4.90) T la y = 0, T a y = 0, D (A)f ob y + £>i(A)r 16 y = 0, A G C_. 

has a unique solution y(t, A) = yf(t, A) and the equality (4.4) defines a generalized resolvent 
R(X) =: R r (X) ofT. If in addition H = {0}, then for each generalized resolvent R(X) of T 
there exists a unique r G R_i(Hb, Tib) such that R(X) = R T (X). 

Remark 4.11. Let in Theorem 4.10 r = {t+,t_} G R-i(H b ,H b ) be defined by (2.3) with 

(4.91) C (X)=P Hb ^[n b ,n b \), Ci(A) = 0, D (X)=I nb , D 1 (\)=0 

and let A be the symmetric extension (3.58). Then Ro(X) := P T0 (A) is if the form (4.49). 

Proposition 4.12. Let in Case 5 II = {Ho ©%i,ro,ri} 6e a decomposing boundary 
triplet (3.42), (3.44) for T max , let J±(-) be the ^-fields and let 

/Mi (A) M 2+ (A)\ 

(4.92) M+(A) = N 1+ (X) N 2 +(X) \ : H ®U h ^ H ® H ®U bl A G C+ 

\M 3+ (A) M 4+ (A)/ 

(4.93) M_(A)-(^W jJ-W ^J):^^^^^ A G C_ 

be the block representations of the corresponding Weyl functions. Assume also that mo(-) : 
C \ M — ► [i?o] «s the operator function defined by 

(4.94) ™ (A) = ( jjf^ ,y :H®H^H®H, AgC+ 

(4.95) m (A) = ( Ml Q (A) :H®H^H®H, A G C_. 

Then: 1) For every A G C \ R t/iere erriste an operator solution vq(-, A) G £^[i?o 5 IHI] °/ P<7- 
(3.3) such that (4.9) and (4.10) hold and 

(4.96) T> (A) =P S , AgC_, 

(4.97) f ofc i;o(A) = iP^M 3+ (A)P ff (G [#0,%]), IWA) = -P m M 3+ (A)P ff , A G C+, 

(4.98) f ofc w o (A) = 0, r 16 t;o(A) = (-M 3 _(A) : -JV 2 _(A)), A G C_. 
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2) For every A £ C + (A £ C_) there exists a solution u + (-,X) £ £^["Hb,H] (resp. 
m_(-,A) £ £^[?4,H]J o/£g. (3.3) such that 

(4.99) ri o «±(A)=0, A£C±, 

(4.100) (r 0a + f„)u+(A) = M 2+ (X) + N 2+ {\), A £ C+, 

(4.101) r 0a «_(A) =M 2 _(A), f o u_(A)=0, A£C_. 

(4.102) f Qb u + {\) = I Hi +iPuM A+ {\), T lb u+(X) = -P nb M i+ (X), A £ C+, 

(4.103) f 06 «-(A) = I% b , r lb u_(A) = -M 4 _(A), A £ C_. 

3) The following equalities hold 

(4.104) 7+ (A) \H b = ttu+(X), A£C+; 7 _(A) \ U b = 7ru_(A), A £ C_. 

Proof. As in Proposition 4.4 one proves the existence of isomorphisms Z + (X) : Hi — > 
7V A (A £ C+) and Z_(A) : "Ho — > A/a (A £ C_) satisfying (4.62) and (4.63) or, cquiva- 
lently, the equalities 

(4.105) 

r \ /t n \ / ~ 0a \ / Ml ^ M2 +W 

'"^Z + (A)= J * T a U + (A)= iV 1+ (A) iV 2+ (A) I , A £ C+, 









fa 


j Z+(A) 


["lb - i^b, 









■a 


J g 




J u b 



r '"' ' " " 1 / '" ' ' - ■ > <M 3+ (A) U^.A), 

(4.106) i iT a I Z_(A) =10 J g 1, A£ 



(4 - 10?) v -r 16 J Z - {X > - VM 3 _(A) iV 2 _(A) M 4 _(A)J' AGC - 

It follows from (4.105)-(4.107) that 

(4.108) T la Z+{X) = (-I H : 0), A£C+; T la Z_(X) = (-I H : : 0), X £ C_, 

(4.109) (r 0a + f a )Z + (X) = Z + (X) = :H®%,^H®H, 

(4.110) (r 0a + f„)Z_(A) = ( ~° a> ) Z_(A) = 



r„ 



Mi (A) JVi_(A) M 2 _(A) 
-ilfi 



:H®H®U b ^H®H, 



(4.111) r ofc Z+(A) = (0 : I Hb ), T b Z + (X) = (»P^M 3+ (A) : iP^M 4+ (A)), A £ C+, 

(4.112) r lb Z+(A) = (-P m M 3+ (A) : -P„ 6 M 4+ (A)), A £ C+, 
(4.113) 

T ob Z_(X) = (0:0: T lb Z_{X) = -(M 3 _(A) : JV 2 -(A) : M 4 _(A)), A £ C_, 

and combining of (3.40) with (4.111) gives 

(4.114) f Qb Z + (X) = (iP^M 3+ (A) : I Hb + iP^M 4+ (A)), A £ C+. 
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Assume that 



(4.115) Z+(X) = (r(A) : u+(A)) : H ®U b ^ Af x , A G C+, 

(4.116) Z_(A) = («d(A) :u_(A)) :H ®H b ^N x , A G C_, 

are the block representations of Z±(A) (see (3.41) ) and let 

(4.117) «o(A) := (r(A) : 0) : H ® H ^ Af x , A G C+. 



Then the equalities (4.115)-(4.117) define the linear mappings t>o(A) : i?o — ► -Yx (A G 
C \ R), u+(A) : Hfc -> A/a (A e C+) and it_(A) : H b -)■ A/a (A G C_), which according to 
Lemma 3.2 generate the operator solutions v (-,X) G £^[i/o,H], u +(-,^) G £^["H6,H] and 
u_(-,A) G £i[^6,H] of Eq. (3.3). Combining now (4.115)-(4.117) with (4.108)- (4.110) 
and taking the equalities (4.94) and (4.95) into account we arrive at the relations (4.9), 
(4.10), (4.96) and (4.99)-(4.101). Moreover, the block representations (4.115)-(4.117) and 
the equalities (4.112)-(4.114) lead to (4.97), (4.98) and (4.102), (4.103). 

Finally, (4.104) is implied by (4.21) and (4.115), (4.116). □ 

Theorem 4.13. Let the assumptions of Proposition J^.12 be satisfied, let r = {t + ,t_} G 
R-i(Hb,Hb) be a collection of operator pairs (2.3) and let 



(4.118) S*_(A) = (M 3 _(A) : N 2 -{\)) :H®H^H b , A G C_. 

Then: l)the statement 1) of Theorem 4-5 holds with the boundary condition (4.37) and 
the following boundary conditions in place of (4. 38) -(4.40): 

(4.119) if a v T (\)=P s , AeC_, 

(4.120) C (X)f ob v T (X) + Ci(A)ri 6 t; T (A) = 0, A G C+, 

(4.121) J D (A)f ob « T (A)+ J D 1 (A)r lb « T (A) =0, A G C_. 

2) the solution v T (-, A) is of the form 

(4.122) v T (t,X)=vo(t,X)-u + (t,\)(Tl(X) + M 4+ (\))- 1 M 3+ (X)P H , A G C+ 

(4.123) v T (t,X) = v (t,X) -u_(t,A)(r_(A) + M 4 _(A))" 1 5_(A), A G C_. 



Proof. Let us show that the solution v T (-, A) G C 2 A [H ,W] of Eq. (3.3) defined by (4.122) 
and (4.123) satisfies the boundary conditions (4.37) and (4.119)-(4.121). 

Combining (4.122) and (4.123) with (4.9) and (4.99) we obtain the equality (4.37). More- 
over, (4.122) and (4.123) together with (4.96) and the second equality in (4.101) give (4.119). 

Next assume that T+(A) = (r*(A) + M 4+ (A))-\ A G C+, and T_(A) = (r_(A) + 
M 4 _(A)) _1 , A 6 C_. Then by using (2.11) one obtains 

(4.124) r+(A) = {{(-T+(A) + iP^ - zP^M 4+ (X)T + (X))h, 

{-P Ub + P Ub M i+ {X)T + {\))h} : h G H b }, 

(4.125) r_(A) = {{T-(X)h, (I - M 4 _(A)T_(A))/i} :heH b } 
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(c.f. proofs of the equalities (4.43) and (4.44) in Theorem 4.5). Moreover, combining (4.122) 
and (4.123) with with the equalities (4.97), (4.98) and (4.102), (4.103) one gets 

T ob v T (\) = (iP nb - T+(A) - iP nb M 4+ (X)T + (X))M 3+ (X)P H , A e C+, 

r lb v T (X) = (-P Hb + P nb M i+ (X)T + (X))M 3+ (X)P H , X e C+, 

T ob v T (X) = -T_(A)5_(A), T lb v r (X) = -(I - M 4 _(X)T_(X))S_(X), X e C_, 

which in view of (4.124) and (4.125) yields the inclusions (4.45). This implies that v T (-,X) 
satisfies (4.120) and (4.121). Finally, by using the same arguments as in Theorem 4.5 one 
proves uniqueness of the solution v T {-, A). □ 

5. m-FUNCTIONS 

Assume that II Q = {Ho ©Hi, To, Ti} is a decomposing boundary triplet for T max defined 
by (3.44) and one of the equalities (3.31), (3.38) or (3.42). 

Definition 5.1. A boundary parameter r (at the endpoint b) is: 

a collection r = {t + , t_} e R a (V. b , H b ) of operator pairs (2.3) with a = +1 in Case 
1 and a = — 1 in Case 3; 

— an operator pair r e R(H b ) defined by (2.16) in Case 2. 

If n + = ra_ and II = {"H,r ,ri} is a decomposing boundary triplet (3.34), (3.44) for 
T m ax, then a boundary parameter is an operator pair r = R(H b ) of the form (2.16). 

Let r be a boundary parameter and let v T ( • , A) € £^ [Ho , H] be the corresponding operator 
solution of Eq. (3.3) defined in Theorems 4.5, 4.9 and 4.13. 

Definition 5.2. The operator function m T (-) : C \ M — > [Ho] defined by 

(5.1) m T (X) = (Toa + T a )v T (X) + |-Pg, A e C \ R, 

will be called the m-function corresponding to the boundary parameter r or, equivalcntly, 
to the boundary value problem (4.1)-(4.3) (in Case 1), (4.46)-(4.48) (in Case 2) or (4.88)- 
(4.90) (in Case 3). 

If n+ = n_, then m T (-) corresponds to the boundary value problem (4.1), (4.5). In this 
case the m-function m T (-) will be called canonical if r € R°(H b ). 

It follows from (4.37) that m T (-) satisfies the equality 

(5.2) w Ti0 (A) (= ^ 0a r + w T (A)) = (^ m ^ p J P H^ :Ho^H Q (SH, A e C \ R. 

In the following proposition we show that the m-function m r (-) can be defined in a somewhat 
different way. 

Proposition 5.3. Let W a = {%o ©'Hi, To, Ti} be a decomposing boundary triplet for T max , 
let t be a boundary parameter at the endpoint b and let <p(-,A)(£ [iJo,H]) and ip(-,X)(e 
[Ho,M]), AeC, be the operator solutions of Eq. (3.3) with the initial data 

(5.3) <p a (\)=^*>y.Ho-HI <BH, ^)=(^}pf)-Ho^Ho®H, AeC. 

Then there exists a unique operator function m(-) : C\R — > [H ] such that for every X e C\R 
the operator solution v(-,X) of Eq. (3.3) given by 

(5.4) v(t, A) := ip(t, A)m(A) + ip(t, A) 
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belongs to C\ [Hq , H] and satisfies the following boundary conditions: (4.38) -(4.40) in Case 
1; (4.83) and (4.84) in Case 2; (4.119)-(4.121) in Case 3. Moreover, the equalities v(t, A) = 
u T (t, A) and m(A) = m T (A) are uaZid. 

Proof. Let m T (-) be the m-function in the sense of Definition 5.2 and let v(-, A), AeC\l, 
be the solution of Eq. (3.3) given by (5.4) with m(A) = m T (A). Then in view of (5.3) and 
(5.2) one has v a (X) = v T , a (X) and, consequently, v(t, A) = w T (i, A). Therefore by Theorems 
4.5, 4.9 and 4.13 v(-, A) belongs to C 2 a \Hq, H] and satisfies the required boundary conditions. 
Hence there exists an operator function m(A)(= m T (A)) with the desired properties. 

Assume now that the solution v(-, A) of Eq. (3.3) given by (5.4) with some m(A) belongs to 
£^[i?o,EI] and satisfies the specified boundary conditions. Then in view of (5.3) Ti a v(X) = 
—Ph and according to Theorems 4.5, 4.9 and 4.13 v(t, A) = v T (t, A). Therefore m(A) = 
m T (A), which proves uniqueness of m(A). □ 

Description of all m-functions immediately in terms of the boundary parameter t is 
contained in the following three theorems. 

Theorem 5.4. Let in Case 1 the assumptions of Proposition 4-4 be satisfied and let tq = 
{t + ,t_} be a boundary parameter (2.3), (4.6). Thenmo(X) =m To (A) and for every boundary 
parameter t = {r + , t_} defined by (2.3) the corresponding m-function m T (-) is of the form 

(5.5) m T (A) = m (A) + M 2+ (A)(C (A) - C 1 (A)M 4+ (A))- 1 C 1 (A)M 3+ (A), A e C+. 

Proof. It follows from (4.9) and (4.11)-(4.13) that v (t,X) = v To (t,X) and (4.10) yields 
mo(X) = m To (A). Next, applying the operator r 0a + T a to the equalities (4.41) and (4.42) 
with taking (4.10) and (4.15) into account one obtains 

(5.6) m T (A) = m (A) - M 2+ (A)(r+(A) + M 4+ (A))- 1 M 3+ (A), A e C+, 

(5.7) m T (X) =m (A)-M 2 _(A)(r;(A) + M 4 _(A))- 1 M 3 -(A), A e C_. 

It follows from the equality M* (A) = M_(A) that (A) = m (A), M 2 * + (A) = M 3 _(A), M 3 * + (A) = 
M 2 _(A) and M 4 * + (A) = M 4 _(A). This and (5.6), (5.7) yield 

(5.8) ™;(A)=to t (A), AeC\K. 
Moreover, according to [31, Lemma 2.1] G p(Co(X) — Ci(A)M4 + (A)) and 

-(r+(A) + M 4+ (A))" 1 = (C (A) - C 1 (A)M 4+ (A))- 1 C 1 (A), A G C+, 
which together with (5.6) yields (5.5). □ 

The following corollary is immediate from Theorem 5.4 and the equalities (3.32). 

Corollary 5.5. Let n + — n_, let II = {H, Tq, T\} be a decomposing boundary triplet (3.34), 
(3.44) for T max , let t = {{I Hb ,0);H b } G R°(H b ) and let 

(5.9) M(X) = ^(A)^J :Ho(BHb ^ Ho(BHbj A e C \ R, 

&e i/ie block representation of the Weyl function of II. TTien mo (A) = m To (A) and for every 
boundary parameter r defined by (2.16) i/ie corresponding m-function m T (-) is 

(5.10) m T (A) = to (A) + M 2 (A)(C (A) - Ci(A)M 4 (A))' 1 Ci(A)M 3 (A), A G C \ R. 
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Theorem 5.6. Let in Case 2 the assumptions of Proposition ^.8 be satisfied, let To = 
{(/^j , 0); %],} e R (Hb) and let 5(A) be the operator function (4.87). 

Then: 1) mo(A) = m To (A) and for every boundary parameter r defined by (2.16) the 
corresponding m-function m T {-) is 

(5.11) m r (A) =m (A)+M 2 (A)(C (A) -C 1 (A)M 4 (A))- 1 C 1 (A)5_(A), A G C_. 
2) m r (A) admits the triangular block representation 

(5.12) M A )=(r i,r m i? ) ■■H' @H' 2 ^H' @W 2 , AeC+ 

Ho Ho 

(5.13) m T (A) = f mi ^ (A) m 7; (A) ) :H' ®U' 2 ^H' ®W 2 , A G C_, 

Ho Ho 

where 

(5.14) mi, T (A) =M 1 (A)+M 2 (A)(C (A)-C 1 (A)M 4 (A))- 1 C 1 (A)M 3 (A), AeC\K, 

(5.15) m_, T (A) = JVi_(A) + M 2 (A)(C (A) - C 1 (A)M 4 (A))- 1 C 1 (A)Ar 2 _(A), A e C_, 

(5.16) m+. T (X) =m*_ T (\), A G C+. 

Proof. 1) The equality m (A) = to T0 (A) is implied by (4.9), (4.54) and (4.55) in the same 
way as in Theorem 5.4. Next, by (4.85), (4.86) and (4.10), (4.58) one has 

(5.17) m T (\)=mo{\)-(M 2 {\)+N2+(\))(T(\)+M i (\))- 1 M 3 (\)P H ,, A G C+, 

(5.18) m r (A) =m (A) -M 2 (A)(t(A) +M 4 (A))- 1 M 3 (A)5_(A), A 6 C_. 

It follows from (4.50), (4.51) and the equality M*(A) = M_(A) that for all A G C_ 

(M 3 (\)P H ,y = M 2 (A), M 4 *(A) = M 4 (A), 
(M 2 (A) + N 2+ (X))* = (M 3 (A) : JV 2 _(A)) = 5- (A). 

This and (5.17), (5.18) yield the equality (5.8). Moreover, applying to (5.18) the same 
arguments as in the proof of Theorem 5.4 one obtains (5.11). 
2) It follows from (5.11) and (4.87) that 

-.(A) = ( Ml Q (A) N \^!) + ( M2 (A) ) (C (A) - C 1 (A)M 4( A))- 1 C 1 (A)(M 3 (A) : 7V 2 _(A)) 
for all A G C_. This proves (5. 13)-(5. 15), which in view of (5.8) implies (5.12) and (5.16). □ 

Theorem 5.7. Let in Case 3 the conditions of Proposition J^.12 be fulfilled, let To = {t + ,t_} 
be a boundary parameter (2.3), (4.91) and let 5_(A) be the operator function (4.118). Then: 
1) mo (A) = m To (A) and for every boundary parameter t — {t + ,t_} defined by (2.3) the 
m-function m T (-) is of the form 

(5.19) m T (A) = m (A) + M 2 _(A)(£> (A) - D 1 (X)M 4 -(X))- 1 D 1 {\)S-{X), A G C_. 
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2) The m-function m T (-) has the triangular block representation 
(5.20) m T (A) = (™^$ | J ) :H@H^H@H, A G C+ 



(5.21) m r (A) = ( mi '- (A) m T r (A) ] -+ # AeC 




w/iere 

(5.22) m liT (A) = Mi (A) + M 2 _(A)(£> (A) - Di(A)M 4 _(A))- 1 J D 1 (A)M 3 _(A), A G C_, 

(5.23) m_ ;T (A) = JVi_(A) + M 2 _(A)(£> (A) - D 1 (X)M 4 _{X)y 1 D 1 {X)N 2 _{X), A G C_, 

(5.24) mi >T (A) = m* l T (X), m+, T (A) = m!_ )T (A), A G C+. 

Proof. We give only the sketch of the proof, because it is similar to that of Theorems 5.4 
and 5.6. The equality mo (A) = m To (A) follows from (4.9) and (4.96)-(4.98). Next, by using 
(4.10), (4.100), (4.101) and (4.122), (4.123) one proves the equalities 

m T (A) = m (A) - (M 2+ (A) + JV 2+ (A))(r* (A) + M 4+ (A))- 1 M 3+ (A)P H , A e C+, 

m r (A) = m (A) - M 2 _(A)(t_(A) + M 4 _(A))- 1 5_(A), A G C_, 

which imply (5.8) and (5.19). Moreover, in view of (4.118) the equality (5.19) can be written 
as 

MA) = ( Ml (A) ^) + ( M2 (A) ) (^o(A)- J D 1 (A)M 4 _(A))- 1 J D 1 (A)(M 3 _(A) : N 2 .(X)). 
This and (5.8) yield (5.20) -(5.24). □ 

Proposition 5.8. The m-function m r (-) is a Nevanlinna operator function such that the 
relation 

(5.25) (ImA)" 1 ■Immr(A) > J v*{t, X)A(t)v r (t, A) dt 

holds for all A G C+ in Case 1 and A G C_ in Cases 2 and 3. 
If in addition n+ = n_, then (5.25) holds for all A G C \ K. 

Proof. We prove the proposition only for Case 1 (in Cases 2 and 3 the proof is similar). 

Let Il + = {H a ©■H 1 ,r ,r 1 } be a decomposing boundary triplet (3.44), (3.31) for T max 
and let r = {r + , r_} G R + i(H b , H b ) be a boundary parameter defined by (2.3). Let us show 
that the corresponding m-function m T (-) satisfies (5.25). 

Assume that A G C+, ho G H and let y := v T (X)h , so that y = y(t) = v T (t, X)h , tel. 
Applying the Lagrange's identity (3.5) to {y, Ay} G T ma x and taking the equalities (1.3) and 
(3.16) into account one obtains 

(5.26) Im A • {y, y) A = ± (| |f fc y| | 2 - | \f a y | | 2 ) + Im {T la y, T 0a y) - Im (T lb y, T ob y). 
It follows from (4.38) that PqT b y — T a y + iPqh$ and, therefore, 

(5.27) ll^f fe y|| 2 = ||f a y|| 2 + \\P s h a \\ 2 + 2Im(f a y, P s h ). 
Moreover, in view of (3.29) one has 

(5-28) PwJbV = PwSabV, (Tity, T ob y) = {T lb y, f ob y). 
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Now by using first the decomposition (3.28) and then the equality (5.27) one gets 

(5.29) \\f b y\\ 2 - \\f a y\\ 2 = \\P s ? b y\\ 2 + \\P W r b y\\ 2 - \\? a y\\ 2 = 

\\P S h \\ 2 + 2lm(f a y,P s h ) + \\P w r Qb y\\ 2 . 

Next, according to (5.2) 

(5.30) T 0a y = P H m T {X)h , Y la y = -P H h , 

(5.31) T a y = P s m T (\)h - ^P s h 
and substitution of (5.31) to (5.29) yields 

(5.32) ||f b y|| 2 - \\f a y\\ 2 = 21m (P s m T (X)h , P S h ) + ||P^ f ofc2 ,|| 2 . 
Moreover, by (5.30) one has 

(5.33) Im (Tiay, T Qa y) = Im (P H m T (X)h , PhIio). 

Substituting now (5.32) and (5.33) to (5.26) and taking the second equality in (5.28) into 
account we obtain 

(5.34) lm\ - (y,y) A = lm(m T (X)h ,ho) - (lm(T lb y,f ob y) - ±||P^f 06 y|| 2 ). 

It follows from (4.39) that {Fo b y,Ti b y} e t+(A). Therefore according to [32, Proposition 
4.3] 

(5-35) lm(T lb y,f ob y) - \\\P w f m y\\ 2 > 0. 

Moreover, in view of (3.1) one has 

(5.36) (y, y) A = J (A(t)v T (t, \)h ,v T (t, \)h ) dt=((J v* T {t, X)A(t)v T (t, A) dt)h , ho). 

Combining now (5.35) and (5.36) with (5.34) we arrive at the relation (5.25). 

It follows from (5.5) that the operator function m T (-) is holomorphic in C+. Moreover, 
the relation (5.25) shows that Imm T (A) > for all A e C+. This and (5.8) imply that m T (-) 
is a Ncvanlinna function. □ 

In the following proposition we show that a canonical m- function m T (-) is the Weyl 
function of some symmetric extension of T min . 

Proposition 5.9. Assume that n+ = n_ and II = {'H,ro,ri} is a decomposing boundary 
triplet (3.34), (3.44) for T max . Moreover, let r £ R°(H b ) be a boundary parameter (2.19) 
and let v T (-,X) E C A [H n ,M] be the operator solution of Eq. (3.3) defined in Theorem 4-5. 
Then: 1) The equalities 

f = {{y, /} e T max : y(a) = 0, f a y = f b y, C T ab y + CiT lb y = 0}, 

T* - {{y, 7} e T max : C Q r ob y + dT lb y = 0} 

define a symmetric extension T of T min and its adjoint T* ; 
2) The collection II" = {H , Tfi, T"} with the operators 

(5.37) r^{y,J} = -T la y + i(f a -f b )y, T^{y, /} = T aa y + i(f a + f b )y, {yj}ef\ 

is a boundary triplet for T* . Moreover, the 7 -field 7" (•) and Weyl function M n (•) ofH n are 

(5.38) 7 "(A) =irv T (X), M n (X) = m T (A), A G C \ M; 
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3) the following identity holds 

(5.39) m T (n) -m*{\) = (// - X) J v*{t,X)A(t)v T (t,tJ,)dt, /i,AeC\R. 

This implies that for the canonical m-function m T {-) the inequality (5.25) turns into the 
eqluality, which holds for all A G C \ E. 

Proof. Clearly, we may assume that r is given in the normalized form (2.20), in which case 
the operators 

(5.40) T Q {y, /} = {-r la y + i(f „ - f b )y, C T ob y + C^ny}^ H © H b ), 

(5.41) T^y, /} = {r 0a y + ±(f a + f b )y, CiT^y - C T lb y}(e H © H b ), {y, /} e T max , 
form a decomposing boundary triplet II = {%, r , Ti} for T max . Let 7(A) be the 7-field and 

(5.42) M(A) = (jg^ :H (BH b ^H (BH b , A e C \ R, 

be the Weyl function of the triplet II. Assume also that vo(-, A) G zC^[i/o, H] is the operator 
solution of Eq. (3.3) defined in Proposition 4.4 (for the triplet II). Then Vo(t, A) = v T (t, A) 
and (4.19) yields 7(A) f Hq = nv T (X). Moreover, in view of (4.10) one has mo (A) = 
m r (A), A e C \ K. Applying now Proposition 2.12 to the triplet TT (with Ho = Hi = H ) 
we obtain the statements 1) and 2). Finally, (5.39) follows from the identity (2.45) for the 
triplet II" and Lemma 3.2, 2) applied to the solution v T (-, A). □ 

Remark 5.10. Let II = {"H,r ,Fi} be a decomposing boundary triplet for T max , let t <E 
R (H b ) be a boundary parameter given in the normalized form (2.19), (2.20) and let II = 
{H, r , Ti} be a decomposing boundary triplet (5.40), (5.41) for T max . It is easy to see that 
II and II are connected by 

T \ = (X l X 2 \ (Y^ 

v rJ {x 3 xj {T ly 

where Xj G [H © H b ] are defined as follows: 



CoJ ' z V° ' V° C*!/ ' V° C o 

Therefore according to [6] the Weyl functions M(-) and M(-) of the triplets II and II respec- 
tively are connected via 

(5.43) M(X) = (A 3 + A 4 M(A))(Ax + A 2 M(A))~ 1 . 

By using the block representation (5.9) of M(A) one obtains (Ai + A 2 M(A)) _1 = 
/ \ _1 _ / / 

-C1M3 C0-C1MJ ~ ^(C - CiM^CiMs (C - C 1 M 4 )- 1 y 
and (5.43), (5.42) imply that mo(A) coincides with the right hand side of (5.10). This and 
the equality m T (X) = mo(A) obtained in the proof of Proposition 5.9 yield (5.10). Thus, for 
canonical m-functions m T (-) formula (5.10) is a simple consequence of the relation (5.43) for 
Weyl functions. 

Note that considerations in this remark are inspired by [6, Remark 86], where the Krein 
formula for resolvents was proved in a similar way. 
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6. Particular cases 

6.1. Symmetric systems with minimal deficiency indices. It follows from (3.13) that 
the minimally possible deficiency indices of T m i n are 

(6.1) n+ = v+, n- = V- 

and (6.1) holds if and only if = = or, equivalcntly, [y, z]b = for all y,z E 
doml~ max . This implies that the system (3.2) with minimal deficiency indices of T min is in 
Case 2 and by (3.17) U h = U h = {0}. Therefore in (3.35) 

(6.2) H' Q = H, H' 2 = H 

and the decomposing boundary triplet for T max takes the form II_ = {H © ff,r ,ri}, 
where H a is given by (3.11) and 

(6.3) T {yJ} = {-T la y,if a y}{eH®H), T 1 {yJ} = T 0a y(GH), {yJ}eT max . 

In the case of minimal deficiency indices the symmetric extension T defined by (3.51) 
coincides with 

(6.4) A (= kcrr ) = {{y, /} G T max : T la y = f a y = 0} 

(c.f. (3.54)). The unique generalized resolvent i?o(A) of A is of the form (4.49) and according 
to Theorem 4.6 it is given by the boundary value problem 

(6.5) Jy'-B{t)y = XA(t)y + A(t)f(t), iel, 

(6.6) r la y = 0, AeC+; T la y = 0, f a y = 0, A e C_. 

In view of Theorem 4.9 for each A G C \ R there exists a unique operator solution 
v(-,X) G C 2 A [H ,M] of Eq. (3.3) such that 

T la v(X) = -P H , AeC+; F la v{X) = -P H , if a v{X) = P s , AgC_, 

and according to Definition 5.2 the m-function of the boundary value problem (6.5), (6.6) 
is given by 

(6.7) m(A) = (T 0a + r a )v(X) + ±P s , X e C \ R. 

In view of Proposition 5.3 the m-function m(-) can be also defined by the relations 

(6.8) v(t, A) := ip(t, X)m(X) + tp(t, A) E £ A [H , H], A E C \ E; if a v(X) = Pg, A E C_, 

where (p(-, A) and A) are the solutions of Eq. (3.3) with the initial data (5.3). 
Next, Proposition 4.8, 2) and Theorem 5.6 yield the following proposition. 

Proposition 6.1. Assume that T m i n has minimal deficiency indices (6.1), II _ = {Hq © 
H,To,Ti} is a decomposing boundary triplet (6.3) forT max , 7_(-) is the ^-field and 

(6.9) M+(A) = (M(A) : A r +(A)) T :H^H®H, X E C+, 

(6.10) M_ (A) = (M(A) : N- (A)) : H ®H ^ H, X E C_, 



38 SERGIO ALBEVERIO, MARK MALAMUD, AND VADIM MOGILEVSKII 

are the corresponding Weyl functions. Then 7- (A) = ttv(X), A e C_, and the following 
equalities hold 

(6.11) m(A) = ^ ^ , J ^ : tfej; -)• A e C+ 

(6.12) m(A) = ^7^?) : -> £e_ff, A G C_. 

Ho -Ho 

Formulas (6.11) and (6.12) imp/?/ f/iaf i/ie m-function m(-) coincides with the function M{-) 
corresponding to the decomposing boundary triplet II_ (see (2.38) and (2.39)J. 

Combining the latter statement of Proposition 6.1 with (2.40) and taking the equality 
7- (A) = ttv(X) and Lemma 3.2, 2) into account we obtain the following corollary. 

Corollary 6.2. m(-) is a Nevanlinna operator function satisfying the identity 

(6.13) m(ji) -m*(A) = (/i - X) J v*(t,X)A(t)v(t,n)dt, /i,AeC_. 

Remark 6.3. It follows from (6.8) and (6.11) that the Weyl function (6.9) of the decomposing 
boundary triplet II_ for T max is defined by the relation 



<p(t,X)M + (X) + X (t,X) €Ci[H,M\, A G 



where x(^,A)(e [H, H]) is a solution of Eq. (3.3) with the initial data (1.38). This and (1.37) 
imply that M + (A) coincides with the Titchmarsh - Weyl coefficient Mtw{X) introduced in 
[20] for symmetric systems (3.2) with minimal deficiency indices n± under the additional 
assumption that the operator X a is of the special form (3.20). Observe also that the square 
matrix m(A) defined by (6.11) appears in [20, p. 34], where it forms the upper left block of the 
Nevanlinna matrix M(A) (here M(A) is the Titchmarsh - Weyl coefficient of the "doubled" 
system with equal deficiency indices). 

6.2. Symmetric systems with minimal equal deficiency indices. It follows from 

(3.13) and (3.14) that the minimally possible equal deficiency indices of T min are 

(6.14) n + = n- = v_ 

and the equalities (6.14) hold if and only if = and = v. Therefore by (3.17) and 
Proposition 3.4 the (ordinary) decomposing boundary triplet for T max in the case (6.14) 
takes the form LT = {H , T , T\} with 

(6.15) r {y,/} = (-ri o + i(f o -f 6 ))y, T 1 {yJ} = (T 0a + ^(f a +f b ))y 1 {y,f}eT max , 
where Ft, : domT ma x — > H is a surjective linear mapping such that 

[y,z] b = i(f b y,f b z), y,z edomT max . 
Moreover, the extension (3.49) coincides with the self-adjoint extension 

(6.16) A (= kcrTo) = {{yj} G T max : T la y = 0, f a y = f b y} 

and the canonical resolvent Rq(X) = (Aq — A) -1 , A G C \ M, is defined by the boundary 
value problem (c.f. (4.5)) 

(6.17) Jy'-B{t)y = XA(t)y + A(t)f(t), iel, 

(6.18) r la y = 0, r a y = ? b y, A G C \ R. 
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It follows from Theorem 4.5 that in the case (6.14) for each A G C \ R there exists a unique 
operator solution v(-, A) G £^[iJo,H] of Eq. (3.3) such that 

r 1 v(x) = -p H , *(r a y - f b )v(x) = p s , Aec\t, 

and according to Definition 5.2 and Proposition 5.3 the (canonical) m-function m(-) of the 
boundary value problem (6.17), (6.18) is defined by (6.7) or, equivalently, by the relations 

v(t,\):=(p(t,\)m(\)+il)(t,\)e£ 2 A [H ,M\, i(f a -f b )v(X) = P s , AeC\K. 
Finally, (4.19) and Corollary 5.5 yield the following proposition. 

Proposition 6.4. LetT min has minimal equal deficiency indices (6.14), letli = {H ,T ,Ti} 
be the decomposing boundary triplet (6.15) for T max , let j(-) and M(-) be the corresponding 
"f -field and Weyl function respectively and let m(-) be the m-function of the boundary value 
problem (6.17), (6.18). Then 

7(A)=7ro(A), M(A)=m(A), A G C \ R, 

and the identity (5.39) holds with m T (A) = m(A) and v T (t,X) = v(t,X). 

6.3. Hamiltonian systems. Recall that the system (3.2) ia called Hamiltonian if v + = 
v- =: v, in which case the following assertions hold: 

1) H = {0}, so that H = H (BH (with dimH = v) and the signature operator (1.3) takes 
the form (1.5); 

2) the deficiency indices of T min are n± = v + v b ± (c.f. (3.13)); 

3) the block representation (3.19) of the mapping T a takes the form 

T Q = (J° a ) : AC(1: U)^H®H. 

In this subsection we let 

a = sign (v b+ - v b _) = sign (n+ - n_). 

Clearly, the Hamiltonian system (3.2) is in Case 1 when a E {0, 1} and in Case 3 when 
a = — 1. Moreover, in view of (3.14) n + = ra_ if and only if 

(6.19) v b+ = v b - =: v b . 

Assume that and T-L b are Hilbert spaces and T b is a surjective linear map (3.15) such 
that (3.16) holds. Let H b = H b © H b and let r h : domTmax T~Lb be the mapping (3.40). 
The following proposition is implied by Proposition 3.4. 

Proposition 6.5. Let in the case of the Hamiltonian system (3.2) Ho ■= H (B H b , Hi = 

H (B H b and let Tj : T max — > Hj, j G {0, 1}, be the linear maps given for {y, /} G T max by 

(6.20) T {y, /} = {-r lo y, f 06 y}(G H © H b ), T x {y, /} = {r 0a y, -r lb y}(G H © H b ). 

Then the collection II Q = {Ho © Hi, T , Ti} is a decomposing boundary triplet for T max . 

If in addition n + = n_, then U a turns into the ordinary boundary triplet U = {H, T , Ti}, 
where H = H ®H b and the operators r and Y\ are given by (6.20) with H b = H b and 

Tot = r 6. 
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It follows from Propositions 3.7 and 3.9 that in the case of the Hamiltonian system the 
equality 

(6.21) T = {{y, /} G T max : T la y = 0, f ob y = T lb y = 0} 

defines a symmetric extension T of T m j„ with the deficiency indices n±(T) = v b ±. If in 
addition n + = ra_, then in (6.21) r h = r h and T has equal deficiency indices n + (T) = 
n-{T) = y b . 

Theorems 4.1 and 4.10 yield the following theorem. 

Theorem 6.6. Let in the case of the Hamiltonian system (3.2) IIq, = {^Hq@'H\,Yq,Y\) be a 
decomposing boundary triplet (6.20) for T max . If t = {t + ,t_} G R a {H b ,T-Lb) is & collection 
(2.3), then for every f G the boundary value problem 

(6.22) Jy' - B(t)y = XA(t)y + A(t)/(t), t G X, 

(6.23) r la y = 0, AeC\l 

(6.24) Co(A)f ofc2 / + Ci(A)r lb y = 0, A G C+; £> (A)f 06 y + Di(A)ri t y = 0, A G C_, 

/ias a unique solution y(t, A) = y/(t, A) and the equality (4.4) defines a generalized resolvent 
R(X) =: R T (X) ofT (see (6.21) ^. Conversely, for each generalized resolvent R{\) ofT there 
exists a unique t G R a {'H bl 'H b ) such that R(X) = R T (X). 

If in addition n + = n_ and II = {"H,ro,ri} is an ordinary decomposing boundary triplet 
for T max , then the statements of the theorem hold with the Nevanlinna operator pairs t G 
R(H b ) in the form (2.16) and the boundary conditions 

(6.25) r la y = 0, Co(A)r 6t/ + C 1 (A)r 16 y = 0, A e C \ K, 

instead of (6.23) and (6.24). In this case R T (X) is a canonical resolvent ofT if and only if 
t e R°(H b ). 

For Hamiltonian systems the operator solution v T (-, A) takes on values in [if, H] in place 
of [ifo, M] for general systems. More precisely, the following theorem is implied by Theorems 
4.5 and 4.13. 

Theorem 6.7. Let the assumptions of Theorem 6.6 be satisfied. Then for each collection r = 
{t + ,t_} G R a {y. b ,T-L b ) defined by (2.3) there exists a unique solution v T (-,X) E £^[if,H] of 
Eq. (3.3) such that 



(6.26) Y la v T (X) = -I H , AeC\K, 

(6.27) C (A)f ob v T {X) + d(A)r 16 u r (A) =0, A G C+, 

(6.28) D (X)f ob v T (X) + £>i(A)ri 6 « T (A) = 0, A G C_. 

If n + = n-, then r G R{H b ) is given by (2.16) and the conditions (6.26)-(6.28) take the 
form 

(6.29) Y la v T (X) = -I H , Co(X)T ob v T (X) + diX^uVriX) = 0, AgC\K. 

Next, a boundary parameter in the sense of Definition 5.1 is a collection r = {t + ,t_} G 



R a (H b , H b ) of operator pairs (2.3). Moreover, in the case n + = ra_ the boundary parameter 
is an operator pair r G R{% b ) given by (2.16). 

For Hamiltonian systems Definition 5.2 and Proposition 5.3 take the following form. 
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Definition 6.8. The operator function m T (-) : C \ M — > [H] defined by 

m T (A) =r 0a w r (A), A G C \ R, 

is called the m-function corresponding to the boundary parameter r or, equivalently, to the 
boundary value problem (6.22)-(6.24). 

If n + = n-, then m T (-) corresponds to the problem (6.22), (6.25). In this case the 
m-function m T (-) is called canonical if r G R°(Hb)- 

Proposition 6.9. The m-function m T (-) is a unique [H]-valued function such that 

(6.30) v T (t,\) :=ip(t,\)m T (\)+i)(t,\) £ £ 2 A [H,U], AeC\M, 

and the boundary conditions (6.27) and (6.28) are satisfied. If in addition, n + = n_ and 
t G R°(Hb) is given by (2.19), then the conditions (6.27) and (6.28) take the form 

(6.31) CoTobV T (X) + CiT lb v T (X) =0, AgC\R. 

In formula (6.30) tp(-, A) and ip(-,\) are the operator solutions of Eq. (3.3) with values in 
[H, H © H] and such that 

VaW = (^f) ■ H -> H ® H, Va(A) = (Jjj :H^H®H, A G C. 

The following theorem is implied by Theorems 5.4, 5.7 and Corollary 5.5. 

Theorem 6.10. Let the conditions of Theorem 6.6 be satisfied and let to = {t+,t-} be a 
boundary parameter (2.3) defined by (4.6) in the case n+ > n_ and by (4.91) in the case 
n + < n_. Assume also that the Weyl functions M±(-) have the block representations: 
- in the case n + > n_ 

^+(A)=fr% ^ 2+{ ^:H®H h ^H®Ub, AGC + ; 



M 3+ (A) M 4+ (A) 



in the case n + < n_ 



t 2 r { S)--H®nb^H^n b , AGC_ 



V M 3 _(A) M 4 _(A) y 

Moreover, let t = {t + ,t_} be a boundary parameter (2.3). Then: 1) m (A) = m T0 (A); 2) 
in the case n + > n_ i/ie equality (5.5) holds; 3) in the case n + < n_ the equality 

m T (A) - m (A) + M 2 _(A)(A)(A) - ^i(A)M 4 _(A))- 1 ^ 1 (A)Af 3 _(A), A G C_, 

is valid. Moreover, if n + = n_ and the Weyl function M(A) has the block representation 
(5.9) with H instead of H , then for every boundary parameter r in the form (2.16) the 
equality (5.10) is valid. 

For the Hamiltonian system the minimally possible deficiency indices of T min are 

(6.32) n + = n_ = v{= dimtf), 

in which case the boundary triplet (6.20) for T max takes the form II = {H, r ,ri} with 

(6.33) T {yJ} = -T la y, T^y, /} = T 0a y, {yJ}eT max , 
and the extension (6.21) turns into the self-adjoint extension 

M= kcrr o) = {{V, 7} S T rnax : T la y = 0}. 
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Moreover, the resolvent R(X) = (Aq — A) -1 , A e C \ 1, of this extension is defined by the 
boundary value problem (6.22), (6.23). 

It follows from Theorem 6.7 that in the case (6.32) for each A G C\K there exists a unique 
operator solution v(-, A) G £^[i?,H] of Eq. (3.3) such that Ti a v(X) = —Ih- The m-function 
of the problem (6.22), (6.23) is defined by m(A) = r 0a «(A), A G C \ R, or, equivalcntly, by 
the relation 

v{t,X) := <p{t,X)m{X) + ^(t,A) G C 2 A [H,M\, A e C \ R. 

Note in conclusion, that according to Proposition 6.4 m(-) is the Weyl function of the 
boundary triplet (6.33). 

Remark 6.11. Assume that n + = ra_ and the operators r fc and in (6.20) are defined 
by (3.26). Moreover, let r G R (C Ub ) be a self-adjoint boundary parameter (2.19). Then 
by using the matrix representation of Co and C\ one can express the boundary condition 
(6.31) as 

[v T (-,X)h,Xj]b = 0, /i G H, j = l + v b , 
where \j € &omT mo .x are linear combinations of V'fe and 6>fc. This and Proposition 6.9 imply 
that the canonical m-function m r (-) is the Titchmarsh - Weyl coefficient of the Hamiltonian 
system in the sense of [19]. 

7. Applications to differential operators 

In this section we apply the above results to operators generated by a differential expres- 
sion l[y] of an odd order r = 2n + 1 defined on an interval 1 = [a, b) (— oo < a < b < oo) 
with the regular endpoint a. Such an expression is of the form [41] 

(7.1) i[y] = i {]T(-i) fc (m^y {k) ) {k+1) + {q n - k y {k+1) ) {k) \ + ( Pn - k y {k) ) {k) ) ) , 

U=o J 

where Pj(-), qj(-) and w(-) are real valued functions on I such that : 1) Pj(-) and qj(-) arc 
smooth enough and qo{t) > 0, t E X; 2) w(-) G Li({a,(3]) for each j3 G 1 and w(t) > a.e. 
on 1. Denote by y' fc '(-), k = 2n + 1 the quasi-derivatives of a complex-valued function 
y(-) G Ac(I) and let doml be the set of functions y(-) for which /[?/] := y[ 2n+1 ] makes sense 
[41, 24, 40]. For each y G domZ we let 

l^Ht) := {y [k - 1] (t)r k=1 (e C"), y( 2 )(t) := {y^~ k ^ (t)}^ C"), 
y(t) = {y( 1 )(t),y(t),y( 2 )(t)}(GC 2 "+ 1 ), 

where y(t) = (t)y( n \t). Moreover, for each m-component operator solution 

(7.2) Y(t, A) = ( yi (t, A) : y 2 (t, A) : . . . A)) : C m -> C 
of the differential equation 

(7.3) l[y] = Xy (AgC) 
we put 

Y^(t,X) = (y[ j) (t,X) : y^(t,X) : ... : A)) : C m -> C n , jG{1,2}, 

?(t,A) = (&(*, A) : fc(t,A) : ... : £ m (t, A)) : C m -> C, 
Y(t, A) = (y (1) (i, A) : ?(t, A) : y (2) (t, A)) T : C m -> C 2 " +1 , i G 1. 
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Next assume that L 2 r (T) is the Hilbcrt space of all complex- valued Borcl functions on X 
such that J x r(t)\f(t)\ 2 dt < oo. It is known [41] that the expression (7.1) generates in L 2 (Z) 
the maximal operator L and the minimal operator L . Moreover, L is a closed densely 
defined symmetric operator and Lq = L. 

By using the results of [24] one can easily prove the following assertion. 



Assertion 7.1. Let l[y] be the expression (7.1) and let 




_ (w{t) 



./., - jo //, o | e ;C" l C"]. A () (/) = ("^ |JJe[C®C 2 "]. 

Then there exists a continuous operator function B (t) = B^t) G [C 2n+1 ] (defined in terms 
of pj and qj) such that: 

1) a complex- valued function y(-,X) (operator function Y(-,X) of the form (7.2)) is a 
solution of Eq. (7.3) if and only ify(-,X) (resp. Y(-,X)) is a solution of the symmetric 
system 

(7.4) J y'-B (t)y = XA (t)y, t G 1; 

2) the equality 

(7-5) V{y,f} = {yJ}, {y,/}GgrL, 

with f(t) = {f(t), 0, 0}(G C 2n+1 ) defines a unitary operator V : grL — > T m ax, where 

%nax is the maximal relation in C\ a il) for the system 

(7.6) J y'-B (t)y = A (t)f(t), tel. 

Moreover, V grL = Tmin, where T m in is the minimal relation for the system (7.6). 

Assertion 7.1 enables us to identify all the objects related to the expression (7.1) with 
similar objects for the system (7.6). In particular, we assume that: 1) v\,+ and v\>- arc 
indices of inertia of the bilinear form (3.6) for the system (7.6); 2) the linear map Tb in 
(3.15) is defined on doml, so that T by, ^ibV and Ti,y are the singular boundary values of a 
function y E domi and its quasi-derivatives (c.f. Remark 3.3). Moreover, let X a G [C 2n+1 ] 
be the operator such that X*J X a = J and let 

r a = (r 0a : f a : r la ) T : domz -». c n e c e c n 

be the linear map given by T a y — X a y(a), y G domL 

Clearly, for the system (7.6) one has V- — u + = 1. Hence this system is either in Case 1 
or in Case 3 and the reasonings in Subsection 3.3 take the following form: 

1) Case 1: — v\>- > 1 or, cquivalcntly, n_(Lo) < n + (Lo). In this case we put 
d = u b+ - v h _ - 1, H b = and U h = C d ffi C (c.f. (3.28)), so that the operator f 6 can 
be represented as 

f 6 = (T' b : f^) T : domi -> C d (B C. 

This implies that H b = C u "- © C d and by (3.29) f ob = (r 06 : ?' b ) T . 

2) Case 3: Vb+ — v b - < or, cquivalcntly, n + (Lo) < n_(Lo). We put d! = v b - — 
v b+ , U b = C>+ and U b = C d ' (c.f. (3.39)). Then H b = ® C d ' (= and in view of 
(3.40) one has 

Tot = (r 06 : f fc ) T : domL -> C""+ © C d ' . 
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Now by using Assertion 7.1 one can easily reformulate all the previous results for sym- 
metric systems (3.2) in terms of the expression (7.1). For example Theorems 4.5, 4.9 and 
4.13 take the following form. 

Theorem 7.2. Let r = {t + ,t_} G R a (Hb,'Hb) be a collection of operator pairs (2.3) with 
a = +1 in the case n_(Lo) < n + (Lo) and a = —1 in the case n+(Lo) < Ti-(Lo). Then for 
each A £ C\l there exists a unique (n + l)-component operator solution 

(7.7) v T (t, A) = («i(t, A) : v 2 (t, A) : ... v n (t, A) : v n+1 (t, A)) : C" ® C -> C 

of Eq. (7.3) such that Vj(-,X) G j = 1-f- (n + 1), and £/ie following boundary conditions 

are satisfied: 

1) in the case n_(L ) < n + (L n ) 

(7.8) r la v r (A) = (-J c » : 0) : C" © C -> C", A G C \ R, 

(7.9) i(f a - f£> T (A) - (0 C » : J c ) : C" © C -»• C, A G C \ R, 

(7.10) C (A)f ofcWT (A) + C 1 (A)r lfc i. T (A) - 0, A G C+, 

(7.11) D (X)f ob v T (\)+D 1 (X)r lb v T (X)^0, AgC_. 

2) in the case n + (L ) < n_(L ) - the conditions (7.8), (7.10), (7.11) and 

(7.12) if a v T (X) = (0 C n : J c ) : C™ © C -> C, A G C_. 
/fere ifte linear map v T (X) : C" © C — > 9?a(£o) * s ff«ven 6t/ 

71+1 

(« T (A)/i)(t) = v T (t,A)/» = ^2vj(t,X)hj, h = {h lt h 2 , ft„, G C™ © C, 

so i/iai r a v T (A) = A a v T (a, A). 

Next, the to- function to t (-) of the expression corresponding to the boundary parame- 
ter t G R a (Hb, %b) (with the same a as in Theorem 7.2) is defined as the to- function of the 
system (7.6). In view of Proposition 5.3 this means that m T (-) : C \ R — > [C" +1 ] is a unique 
operator function such that for every A G C \ K the (n + l)-component operator solution 
(7.7) of Eq. (7.3) given by 

v T (t,X) := Yi(t, A)to t (A) + Y 2 (t, A) 

possesses the following properties: l)vj(-,X) G L 2 r (I) for all j = 1 (n + 1), 2) u T (-, A) 
satisfies the boundary conditions (7.9)-(7.11) in the case n-(L ) < n + (L ) and (7.10)-(7.12) 
in the case n + (L ) < n_(L ). Here Y\(t, A) and Y 2 (t, A) are the (n + l)-component operator 

'l n 0* 

solutions of Eq. (7.3) with the initial data X a Yi(a, A) = (0 h | G [C„ ©C, C„ ©CffiC r 


and AT a Y 2 (a, A) = | -\h ) G [C„ © C, C„ © C © C r ' 

-/n 

According to results in Section 5 m T (-) is a Nevanlinna operator function, which in the 
case n + (L ) < n_(L ) has the triangular form (5.20) and (5.21) with H = C" and H = C. 

The reformulations of other results in Sections 5 and 6 to the case of the m-functions of 
the differential expression (7.1) are left to the reader. 
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